-- Logs begin at Wed 2022-10-26 10:27:51 UTC, end at Wed 2022-10-26 11:21:14 UTC. -- Oct 26 10:51:14.216270 dv-cinder-815582-18-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 26 10:51:14.224967 dv-cinder-815582-18-smb devstack@keystone.service[81533]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 10:51:14 2022] *** Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: nodename: dv-cinder-815582-18-smb Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: machine: x86_64 Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: clock source: unix Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: pcre jit disabled Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: detected number of CPU cores: 4 Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: current working directory: / Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: detected binary path: /usr/bin/uwsgi-core Oct 26 10:51:14.226940 dv-cinder-815582-18-smb devstack@keystone.service[81533]: your processes number limit is 47680 Oct 26 10:51:14.227507 dv-cinder-815582-18-smb devstack@keystone.service[81533]: your memory page size is 4096 bytes Oct 26 10:51:14.227507 dv-cinder-815582-18-smb devstack@keystone.service[81533]: detected max file descriptor number: 2048 Oct 26 10:51:14.227507 dv-cinder-815582-18-smb devstack@keystone.service[81533]: lock engine: pthread robust mutexes Oct 26 10:51:14.227507 dv-cinder-815582-18-smb devstack@keystone.service[81533]: thunder lock: enabled Oct 26 10:51:14.227507 dv-cinder-815582-18-smb devstack@keystone.service[81533]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 26 10:51:14.227507 dv-cinder-815582-18-smb devstack@keystone.service[81533]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 10:51:14.266727 dv-cinder-815582-18-smb devstack@keystone.service[81533]: Python main interpreter initialized at 0x55f551a289c0 Oct 26 10:51:14.266727 dv-cinder-815582-18-smb devstack@keystone.service[81533]: python threads support enabled Oct 26 10:51:14.266727 dv-cinder-815582-18-smb devstack@keystone.service[81533]: your server socket listen backlog is limited to 100 connections Oct 26 10:51:14.266727 dv-cinder-815582-18-smb devstack@keystone.service[81533]: your mercy for graceful operations on workers is 90 seconds Oct 26 10:51:14.267090 dv-cinder-815582-18-smb devstack@keystone.service[81533]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 10:51:14.267173 dv-cinder-815582-18-smb devstack@keystone.service[81533]: *** Operational MODE: preforking *** Oct 26 10:51:14.267392 dv-cinder-815582-18-smb devstack@keystone.service[81533]: *** uWSGI is running in multiple interpreter mode *** Oct 26 10:51:14.267392 dv-cinder-815582-18-smb devstack@keystone.service[81533]: spawned uWSGI master process (pid: 81533) Oct 26 10:51:14.267580 dv-cinder-815582-18-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 26 10:51:14.268247 dv-cinder-815582-18-smb devstack@keystone.service[81533]: spawned uWSGI worker 1 (pid: 81544, cores: 1) Oct 26 10:51:14.271809 dv-cinder-815582-18-smb devstack@keystone.service[81533]: spawned uWSGI worker 2 (pid: 81545, cores: 1) Oct 26 10:51:14.271809 dv-cinder-815582-18-smb devstack@keystone.service[81533]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 10:51:18.527976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:51:18.527976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: from cryptography.utils import int_from_bytes Oct 26 10:51:18.528771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:51:18.528771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: from cryptography.utils import int_from_bytes Oct 26 10:51:18.529190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:51:18.529190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: from cryptography.utils import int_from_bytes Oct 26 10:51:18.529293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 10:51:18.529293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: from cryptography.utils import int_from_bytes Oct 26 10:51:18.578452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 10:51:18.578639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 10:51:18.578734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 10:51:18.578821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 10:51:18.578901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] command line args: [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 10:51:18.578973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] command line args: [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 10:51:18.579089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 10:51:18.579212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 10:51:18.579301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ================================================================================ {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 10:51:18.579376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ================================================================================ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 10:51:18.579509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] admin_token = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.579596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] admin_token = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.579750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] config_dir = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.579836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config_dir = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.579938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580021 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] config_source = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config_source = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] debug = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] debug = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.580950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.581965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_config_append = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_config_append = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_dir = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_dir = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_file = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.582955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.583140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.583315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.583481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.583657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.583805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.583805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.584144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.584250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.584506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.584673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.584777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.585008 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.585155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.585361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.585510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.585686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.585859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.586993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] publish_errors = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.587985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] publish_errors = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588858 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.588991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] standard_threads = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] standard_threads = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.589941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] use_journal = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_journal = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] use_json = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_json = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] use_stderr = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.590939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_stderr = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.591055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] use_syslog = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.591177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_syslog = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.591290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.591406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 10:51:18.591518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.591628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.591739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.591862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.592032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.592685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.592840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.592986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593334 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.593907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.594889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595467 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.595930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596169 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.596951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.597878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.598926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.599954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.600896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.601907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602017 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.602995 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603339 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.603917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.604917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.605961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.606080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.606193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.606294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.606669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.606791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.606916 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607491 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.607945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.608912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.609920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.610953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.611981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612465 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.612931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.613908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.614976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.615899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616236 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.616939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.external = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.external = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.617891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.password = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.password = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] auth.token = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.token = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.618938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619169 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.619985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.620974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.621892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622360 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.622932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.623967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.624904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.625939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.626973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.627969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628467 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.628820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.629915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.630959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.631990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.632941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.633972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.634900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.635925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.636918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.637943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.638756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.639562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.639690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.639805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.639918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640523 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.640972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.641998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.642910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.643958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.644901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.645936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.646965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.647886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.648978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.649892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] role.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650774 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] role.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.650980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.651892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.652968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653198 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.653887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.654001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.654114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.654227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.654366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.655890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.656944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.657992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658467 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.658925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.659953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.660905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.661940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.662976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.connection = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.663921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.664976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.665892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.666928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 10:51:18.667958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 10:51:18.667958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 10:51:18.693770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.693979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.694081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.694217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.694307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.694448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.703569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.704458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.733419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.733654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.734125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.734363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.785510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.785675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.833485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.833717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.834388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.834626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.989456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.989691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.989781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.989910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.989995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:18.990787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.013604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.013723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.013867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.013961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.014885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.015022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.015101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.026097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.026333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.039341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.039544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.039736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.039831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.039972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.040880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.041095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 26 10:51:19.057774 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.057989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:51:19.058319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.058401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.058521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:51:19.058612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:51:19.058795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.058874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.059051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 26 10:51:19.059132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.059328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.059558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.059647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.059826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.060090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.060371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.069195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.069480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.069747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.069828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.070029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.070111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.070305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.070591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.077653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.077752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.080571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.080668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.080861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.080944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.081964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.082973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.083168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.083256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.083438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.083518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.106803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.106911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.108873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.108966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.109161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.109261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.115635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.115722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.115924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.116007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.116206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.116287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.122632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.122722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.122923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.123003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.127130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.127218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.127428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.127510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.127725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.127819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128102 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.128958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.129156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.129235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.144780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.144866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.145061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.145142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.148953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.149054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.152173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.152261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.152495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.152615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.157264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.157354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.160408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.160491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.163629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.163723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.163931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.164911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.165108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.165196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.181442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.181535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.181731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.181874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.181998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.182091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.182261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.182343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.189185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.189271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.190727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.190856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.192272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.192391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.192587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.192670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.195221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.195302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.195506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.195587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.195896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.195985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.196182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.196263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.196491 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.196574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.207649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.207752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.207936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.208997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.209203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.209285 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.209481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.209562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.225398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.225504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.228298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.228424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.231257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.231339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.233569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.233665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.235180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.235263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.235475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.235555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.235758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.235840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.242143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.242229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.243613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.243713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.246640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.246730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.246929 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.247010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.247217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.247301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.247496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.247577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.255351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.255439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.255642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.255724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.255934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.256058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.263694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.264284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 26 10:51:19.264527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.264610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.264810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.264889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.265997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.266991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.267903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 26 10:51:19.301294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f551a289c0 pid: 81545 (default app) Oct 26 10:51:19.301391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f551a289c0 pid: 81544 (default app) Oct 26 10:51:19.304589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e65b-fc1f-4183-a3b6-1cde37c9d30c None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:19.304881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e65b-fc1f-4183-a3b6-1cde37c9d30c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:19.305156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e65b-fc1f-4183-a3b6-1cde37c9d30c None None] PATH_INFO: `/v3` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:19.309375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed Oct 26 10:51:19 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:26.001750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.002302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.002302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.006637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:26.011848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:26.012407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:26.012407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:26.081567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: INFO dbcounter [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] Registered counter for database keystone Oct 26 10:51:26.100839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 10:51:26.107219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writer thread running {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 10:51:26.283522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG passlib.handlers.bcrypt [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81544) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 26 10:51:26.283826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG passlib.handlers.bcrypt [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81544) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 26 10:51:26.341477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:26.343128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:26.469256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:51:26.927572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:26.996022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: INFO dbcounter [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] Registered counter for database keystone Oct 26 10:51:27.017426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG oslo_db.sqlalchemy.engines [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 10:51:27.023527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writer thread running {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 10:51:27.140951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284aaca-5e12-47c7-becc-bfe700fae0cb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:27.145152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:27.145766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:27.146043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:27.146313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:27.154388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:27.206079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 26 10:51:27.206368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cea2d-b576-4a66-8d48-0fb328870647 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:27.215516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Oct 26 10:51:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 10:51:27.222029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:27.239459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba0416-dcd5-40f1-bfe1-c78f8cee770f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:27.243930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:27.245071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:27.245355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:27.245626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] PATH_INFO: `/v3/projects/984efe81cc5c444a9df8508547d09873` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:27.249419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] RBAC: Authorizing `identity:get_project(project_id=984efe81cc5c444a9df8508547d09873)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:27.300030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 26 10:51:27.300391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d302c4f-3590-4b65-908e-510dbfbbeef9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:27.304907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Oct 26 10:51:27 2022] GET /identity/v3/projects/984efe81cc5c444a9df8508547d09873 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:29.404788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf71a-c872-4b57-a002-dee3115037ff None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.405313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf71a-c872-4b57-a002-dee3115037ff None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.405313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf71a-c872-4b57-a002-dee3115037ff None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.409313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:29.414644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.415075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.415195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.434857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:29.436911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:29.444777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:51:29.713202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf71a-c872-4b57-a002-dee3115037ff None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.725018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf71a-c872-4b57-a002-dee3115037ff None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.729170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e54a2-5963-4813-a33f-d9eb5a15ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.729753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e54a2-5963-4813-a33f-d9eb5a15ce9f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.730029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e54a2-5963-4813-a33f-d9eb5a15ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.730297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e54a2-5963-4813-a33f-d9eb5a15ce9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.737928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e54a2-5963-4813-a33f-d9eb5a15ce9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.739683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e54a2-5963-4813-a33f-d9eb5a15ce9f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.748137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 10:51:29.753689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:29.762570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c8bb5-4894-401e-9998-178c60e80c1e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:29.767478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7220b-4548-42fd-9518-05a499f1d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:29.768095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7220b-4548-42fd-9518-05a499f1d0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:29.768405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7220b-4548-42fd-9518-05a499f1d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:29.768683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7220b-4548-42fd-9518-05a499f1d0f1 admin admin] PATH_INFO: `/v3/users/1f7b517c3fb74340aafc06f3b489374a` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:29.769981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7220b-4548-42fd-9518-05a499f1d0f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f7b517c3fb74340aafc06f3b489374a)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:29.771777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7220b-4548-42fd-9518-05a499f1d0f1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:29.773310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed Oct 26 10:51:29 2022] GET /identity/v3/users/1f7b517c3fb74340aafc06f3b489374a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:31.933141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5966a-262d-4726-a48e-4139dede4ee2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:31.933659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5966a-262d-4726-a48e-4139dede4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:31.933659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5966a-262d-4726-a48e-4139dede4ee2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:31.934987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:31.940533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:31.940919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:31.941081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:31.959393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:31.960593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:32.006116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0601e4-2f78-4550-96b3-290660e1dc1c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.006391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0601e4-2f78-4550-96b3-290660e1dc1c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.006657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0601e4-2f78-4550-96b3-290660e1dc1c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.007972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:32.013191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.013468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.013737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.043887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:32.055810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG passlib.handlers.bcrypt [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81545) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 26 10:51:32.056199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG passlib.handlers.bcrypt [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81545) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 26 10:51:32.104934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:32.106504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:32.203695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:32.308012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.332201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:32.411837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e810e3-2d44-4de8-81cc-d6e872ef3be4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.445141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.445776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.446057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.446336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.457386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:32.466246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:32.467825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.468705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:32.475353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.475480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.556380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:32.574613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5487c-4026-481c-8d94-7ea6f051ee5c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.575582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e8bfd-8ea6-416b-810e-57c45dbcb8d5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.578343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:32.609972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.610578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.610857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.611133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.611801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:32.613225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:32.616216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.617142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.617418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.617694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.618537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:32.618843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:32.620271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:32.623147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.sql.core [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:32.623147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:51:32.623147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [parameters: {'id': 'e490451b85ab4bc59be46d31cb4ac25b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:51:32.623147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:51:32.632829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:32.638347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:32.640355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 26 10:51:32.641230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application yield resource Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise self.value Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application session.commit() Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:51:32.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:51:32.642977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:51:32.643837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:51:32.644681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [parameters: {'id': 'e490451b85ab4bc59be46d31cb4ac25b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 26 10:51:32.645476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:32.647630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 8/16] 10.222.0.49 () {60 vars in 1137 bytes} [Wed Oct 26 10:51:32 2022] POST /identity/v3/domains => generated 190 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:32.648816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.738030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b57f5-f3d8-4d57-9aff-82138a5697c3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.762018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e63367-bf9a-4b66-a560-a4291657cd2f None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.770785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.771732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.772019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.772292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] PATH_INFO: `/v3/users/1f7b517c3fb74340aafc06f3b489374a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.773851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] RBAC: Authorizing `identity:get_user(user_id=1f7b517c3fb74340aafc06f3b489374a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:32.775306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:32.776903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/users/1f7b517c3fb74340aafc06f3b489374a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:32.782964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.796304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.796963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.797243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.797511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.807748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:32.809248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:32.815631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:32.818252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:32.827584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:32.828641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:32.829536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:32.829536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:32.829536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:32.835511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:32.836525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.882261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca98f-0bc3-4070-beb4-1ff4ed2c671f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.915160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.915782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.916057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.916324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.917449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:32.918883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:32.920473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:32.925969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:32.935736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f9749-7982-4703-b44e-9cd614ad181a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:32.969810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:32.970410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:32.970680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:32.970956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:32.971588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:32.971889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:32.973318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7afe-0575-49aa-aa62-848e72357730 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:32.990592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 10/20] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:33.025684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225811-b006-48fc-af49-b0131af739f0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:33.027349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:33.062389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58920c-b9a5-464d-8384-04f95d3c929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:33.063060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58920c-b9a5-464d-8384-04f95d3c929d None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:33.063340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58920c-b9a5-464d-8384-04f95d3c929d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:33.063614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58920c-b9a5-464d-8384-04f95d3c929d None admin] PATH_INFO: `/v3/domains/default/users/1f7b517c3fb74340aafc06f3b489374a/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:33.065630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58920c-b9a5-464d-8384-04f95d3c929d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1f7b517c3fb74340aafc06f3b489374a, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:33.067099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58920c-b9a5-464d-8384-04f95d3c929d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:33.184037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 11/21] 10.222.0.49 () {58 vars in 1361 bytes} [Wed Oct 26 10:51:32 2022] PUT /identity/v3/domains/default/users/1f7b517c3fb74340aafc06f3b489374a/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:51:35.593538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a907c-0786-44da-853d-5d23b17771c7 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.594061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a907c-0786-44da-853d-5d23b17771c7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.594061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a907c-0786-44da-853d-5d23b17771c7 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.595702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 11/22] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:35.603354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc403-b0b5-4bde-9e93-4e9d7f520815 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.603771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc403-b0b5-4bde-9e93-4e9d7f520815 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.603956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc403-b0b5-4bde-9e93-4e9d7f520815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.625025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8f7dc403-b0b5-4bde-9e93-4e9d7f520815 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:35.626624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8f7dc403-b0b5-4bde-9e93-4e9d7f520815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:35.702758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:35.872727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6f85-8acd-440d-bc2d-1da75284bdf1 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.873437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6f85-8acd-440d-bc2d-1da75284bdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.873905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6f85-8acd-440d-bc2d-1da75284bdf1 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.875412 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:35.881747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.882310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.882780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.909365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:35.910897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:35.953542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fea18-4ee2-4d5e-aa7a-c43701eb7cbd None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.954156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fea18-4ee2-4d5e-aa7a-c43701eb7cbd None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.954621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fea18-4ee2-4d5e-aa7a-c43701eb7cbd None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.956446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 13/25] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:35.961415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400e6c3-558b-431f-bdbf-7e052ce62eeb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:35.961694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400e6c3-558b-431f-bdbf-7e052ce62eeb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:35.961955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400e6c3-558b-431f-bdbf-7e052ce62eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:35.990160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1400e6c3-558b-431f-bdbf-7e052ce62eeb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:35.991403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1400e6c3-558b-431f-bdbf-7e052ce62eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:36.038805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 13/26] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:36.065501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.084118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 14/27] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:36.105799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.156372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.246940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a7f7-157d-4962-9c0f-ffcf51c2fbe9 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.247282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a7f7-157d-4962-9c0f-ffcf51c2fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.247504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a7f7-157d-4962-9c0f-ffcf51c2fbe9 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.248958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 15/28] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:36.255071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.255357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.255634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.288756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:36.289957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:36.297903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65fa14-571a-4a59-9216-f26947a4641b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.382008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.382657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.382937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.383211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.410742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:36.417370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.419055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.434798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:51:36.450466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:36.451420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:51:36.452207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:51:36.452207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:51:36.452207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:51:36.452207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 14/30] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:36.464943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.555650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.582514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa030-a667-4ac3-9eef-add971c327a0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.623130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.625632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.626109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.626571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.627419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:36.627912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.629819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.656350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:36.657640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.675647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4c6cd-d1ab-4464-9237-2cd8f40391f1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.709016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.749604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.750231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.750511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.750785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.756850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.758329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.767195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57013-f4aa-42d9-9b8c-3e845dca2de0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:36.805836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:36.806864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:36.807382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:36.807899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:36.808848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:36.810569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:36.816636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:36.828802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 16/32] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Oct 26 10:51:36 2022] POST /identity/v3/roles => generated 225 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:36.840837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.933956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 17/33] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Oct 26 10:51:36 2022] POST /identity/v3/roles => generated 219 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:51:36.934916 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:36.972069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e15659-34b6-4b04-bdf1-fd0d176d469f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.021356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319105-cc77-440d-acad-c26157a26575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.022445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319105-cc77-440d-acad-c26157a26575 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.022952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319105-cc77-440d-acad-c26157a26575 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.023414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319105-cc77-440d-acad-c26157a26575 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.024268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319105-cc77-440d-acad-c26157a26575 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:37.026914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319105-cc77-440d-acad-c26157a26575 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:37.085379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:36 2022] POST /identity/v3/projects => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:37.087089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bb0-146d-4e9d-9482-76e9e2eb77b3 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.087636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bb0-146d-4e9d-9482-76e9e2eb77b3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.088106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bb0-146d-4e9d-9482-76e9e2eb77b3 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.096460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 18/35] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:37.105297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.105926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.106415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.147055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:37.150444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:37.166610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0876a78-9af5-4851-a112-4d34b1b10c11 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.236643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.237226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.237508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.237784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.244721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:37.265692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:37.274587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:37.275488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:37.276230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:37.277302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 19/37] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:37.279034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 18/37] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:37.284274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:37.405308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361011fb-89cb-4d7a-a4d5-1ff55c778665 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.442302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.442966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.443246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.443519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.444193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:37.444538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:37.445998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:37.454620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:37.460227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:37.499602 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:37.559444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990bce4-f350-48d4-8cc4-0b5d82ed3bfe None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.584078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:37.597144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.597804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.598086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.598357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] PATH_INFO: `/v3/users/1f7b517c3fb74340aafc06f3b489374a` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.599679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] RBAC: Authorizing `identity:get_user(user_id=1f7b517c3fb74340aafc06f3b489374a)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:37.601335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:37.603040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 19/39] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:37 2022] GET /identity/v3/users/1f7b517c3fb74340aafc06f3b489374a => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:37.609712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:37.636531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:37.701059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe17ea-92de-4ba5-84ab-beb9498b91a8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.719632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a739e-2e27-4c6f-ac9b-f050dbe3986c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.726713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:37.738351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd0268-a726-42eb-8fcc-5572352600a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.739008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0268-a726-42eb-8fcc-5572352600a0 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.739284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0268-a726-42eb-8fcc-5572352600a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.739560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0268-a726-42eb-8fcc-5572352600a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.740246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd0268-a726-42eb-8fcc-5572352600a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:37.741636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd0268-a726-42eb-8fcc-5572352600a0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:37.755653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Oct 26 10:51:37 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:51:37.756452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.756879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b91ef-adef-4ec2-9324-2ddab4943bb4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.757084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.757192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b91ef-adef-4ec2-9324-2ddab4943bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.757366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.757460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b91ef-adef-4ec2-9324-2ddab4943bb4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.757639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.758766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 22/41] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:37.758868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:37.760310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:37.762069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 20/42] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:37.764604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.764892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.765166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.768057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:37.787662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:37.788949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:37.869253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 23/43] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:37.882325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e2eaf-6995-4338-9311-f53ced2397d3 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:37.919647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:37.920895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:37.921178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:37.921452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:37.922237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.domain.id=default, user.id=1f7b517c3fb74340aafc06f3b489374a) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:37.922550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:37.924020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:37.933801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 21/44] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Oct 26 10:51:37 2022] GET /identity/v3/role_assignments?user.id=1f7b517c3fb74340aafc06f3b489374a&scope.domain.id=default&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:38.135268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:38.163705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:38.233123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e46e-8a91-4bc2-a7b7-45e8dc5f7a07 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:38.265628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe5990-d5d9-432f-9877-babb21f46872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:38.266251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe5990-d5d9-432f-9877-babb21f46872 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:38.266529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe5990-d5d9-432f-9877-babb21f46872 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:38.266800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe5990-d5d9-432f-9877-babb21f46872 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:38.267887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe5990-d5d9-432f-9877-babb21f46872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:38.269355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe5990-d5d9-432f-9877-babb21f46872 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:38.270898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:38.276615 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:38.316253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:38.480040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c2d3f-5f97-4011-b71b-fee7dec8d80d None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:38.512977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ee8f7-5245-4614-a0e9-be9fa8c0852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:38.513567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee8f7-5245-4614-a0e9-be9fa8c0852c None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:38.514431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee8f7-5245-4614-a0e9-be9fa8c0852c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:38.514708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee8f7-5245-4614-a0e9-be9fa8c0852c None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:38.515353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ee8f7-5245-4614-a0e9-be9fa8c0852c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:38.516798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ee8f7-5245-4614-a0e9-be9fa8c0852c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:38.542096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:38 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:40.675937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e3545-4251-4299-ba9d-682e46209a6e None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:40.676531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e3545-4251-4299-ba9d-682e46209a6e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:40.676531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e3545-4251-4299-ba9d-682e46209a6e None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:40.677836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:40.683139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:40.683537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:40.683692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:40.702768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:40.704284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:40.770559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:41.036077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e3545-4251-4299-ba9d-682e46209a6e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:41.132999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:41.140492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e3545-4251-4299-ba9d-682e46209a6e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:41.173107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6fbf9-2ddc-4e01-ba5c-f83d2e531900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:41.173721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6fbf9-2ddc-4e01-ba5c-f83d2e531900 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:41.173998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6fbf9-2ddc-4e01-ba5c-f83d2e531900 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:41.174264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6fbf9-2ddc-4e01-ba5c-f83d2e531900 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:41.175350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6fbf9-2ddc-4e01-ba5c-f83d2e531900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:41.176809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6fbf9-2ddc-4e01-ba5c-f83d2e531900 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:41.178348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 26/49] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:41.183876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:41.205433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:41.281611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab328-eb78-42ea-828c-d1273dd8e5ce None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:41.314517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c8a45-d217-44ca-81eb-bf290c12ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:41.315067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8a45-d217-44ca-81eb-bf290c12ad4b None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:41.315344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8a45-d217-44ca-81eb-bf290c12ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:41.315615 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8a45-d217-44ca-81eb-bf290c12ad4b None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:41.316258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c8a45-d217-44ca-81eb-bf290c12ad4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:41.317713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c8a45-d217-44ca-81eb-bf290c12ad4b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:41.342108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 24/50] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Oct 26 10:51:41 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:43.458639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327e46c-c121-482d-a501-b5763db3a5a7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:43.459125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327e46c-c121-482d-a501-b5763db3a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:43.459125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327e46c-c121-482d-a501-b5763db3a5a7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:43.460492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 27/51] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:43.465634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:43.466038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:43.466191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:43.484803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:43.485996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:43.550880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:43.817105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327e46c-c121-482d-a501-b5763db3a5a7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:43.913836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327e46c-c121-482d-a501-b5763db3a5a7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:43.946448 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04906b3d-eb62-42fa-b9ed-1ebb941f72f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:43.947063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04906b3d-eb62-42fa-b9ed-1ebb941f72f8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:43.947341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04906b3d-eb62-42fa-b9ed-1ebb941f72f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:43.947610 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04906b3d-eb62-42fa-b9ed-1ebb941f72f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:43.948796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04906b3d-eb62-42fa-b9ed-1ebb941f72f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:43.950235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04906b3d-eb62-42fa-b9ed-1ebb941f72f8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:43.951827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 28/53] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:43.957152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:43.959311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:44.055168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceeabd-a29f-4ed1-9b05-c4815e4ba599 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:44.087812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e072b0-0333-4fbf-84d3-6a8480dba7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:44.088435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e072b0-0333-4fbf-84d3-6a8480dba7a8 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:44.088717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e072b0-0333-4fbf-84d3-6a8480dba7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:44.088990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e072b0-0333-4fbf-84d3-6a8480dba7a8 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:44.089625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e072b0-0333-4fbf-84d3-6a8480dba7a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:44.091074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e072b0-0333-4fbf-84d3-6a8480dba7a8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:44.117809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 26/54] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:51:43 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:47.244163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee6b5-8516-4842-b018-b4e5a06f09c0 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.244694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee6b5-8516-4842-b018-b4e5a06f09c0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.244766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee6b5-8516-4842-b018-b4e5a06f09c0 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.246080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 29/55] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:47.254778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ee0da-8db1-4e77-8ee1-2893e3b00b9f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.255207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ee0da-8db1-4e77-8ee1-2893e3b00b9f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.255403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ee0da-8db1-4e77-8ee1-2893e3b00b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.281750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ee9ee0da-8db1-4e77-8ee1-2893e3b00b9f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:47.282941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ee9ee0da-8db1-4e77-8ee1-2893e3b00b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:47.355558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:47.376565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 27/56] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:47.504493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7d80-198c-40ce-8019-ff2a13b9d3f5 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.504806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7d80-198c-40ce-8019-ff2a13b9d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.505040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7d80-198c-40ce-8019-ff2a13b9d3f5 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.506385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 30/57] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:47.511505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f47e3-e990-476c-9301-be3065a4be8e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.511793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f47e3-e990-476c-9301-be3065a4be8e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.512073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f47e3-e990-476c-9301-be3065a4be8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.537337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-110f47e3-e990-476c-9301-be3065a4be8e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:47.538526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-110f47e3-e990-476c-9301-be3065a4be8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:47.639587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 28/58] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:47.757258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f786f3-e036-443c-bad4-df5507f1e562 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.757937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f786f3-e036-443c-bad4-df5507f1e562 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.758434 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f786f3-e036-443c-bad4-df5507f1e562 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.760034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 31/59] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:47.765834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.766426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.766907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.797323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:47.798830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:47.874394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b870a-f192-4efa-bd07-d782c36d8cba None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.875041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b870a-f192-4efa-bd07-d782c36d8cba None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.875553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b870a-f192-4efa-bd07-d782c36d8cba None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.877132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 32/60] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:47.882132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 29/61] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:47.882563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:47.883112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:47.883619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:47.883880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:47.992857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.010166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:48.011810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:48.043103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.053711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3850-9092-46b5-8515-d6520e99f63e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.090136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 33/62] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:48.091316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.109778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527af9d9-1a31-4dad-819c-4a0182a7c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.110454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527af9d9-1a31-4dad-819c-4a0182a7c5fd None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.110740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527af9d9-1a31-4dad-819c-4a0182a7c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.111026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527af9d9-1a31-4dad-819c-4a0182a7c5fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.125586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527af9d9-1a31-4dad-819c-4a0182a7c5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-527af9d9-1a31-4dad-819c-4a0182a7c5fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:48.130984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:48.131815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:48.132609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 30/63] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:51:48.133846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498acc3-0915-42ab-8cec-413866abcf49 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.134134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498acc3-0915-42ab-8cec-413866abcf49 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.134410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498acc3-0915-42ab-8cec-413866abcf49 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.135928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 31/64] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:48.141381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498acc3-0915-42ab-8cec-413866abcf49 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.212121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025beac-613f-4aa7-b2b8-1639c8662ba5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.252207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae9044-16fa-45b9-a913-44761c312d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.252844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae9044-16fa-45b9-a913-44761c312d60 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.253071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae9044-16fa-45b9-a913-44761c312d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.253318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae9044-16fa-45b9-a913-44761c312d60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.265386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae9044-16fa-45b9-a913-44761c312d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:48.267907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498acc3-0915-42ab-8cec-413866abcf49 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-fcae9044-16fa-45b9-a913-44761c312d60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:48.271743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:48.272654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:51:48.273415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 34/65] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:48.274040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.276951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.276951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.279109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.293950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:48.295147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:48.306093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.306708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.306993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.307279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.307945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:48.308251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.309683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.312222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.322754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 32/66] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.323561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.370763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:48.377199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.431459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7324c-31a2-4239-ac3b-ad00bf660cd3 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.467536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.468150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.468493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.468768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.475335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9bb0-471f-49f0-8701-670cc56dd818 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.479403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:48.485710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:48.486573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:48.487343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 33/68] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:48.488056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.516747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.517281 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.517557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.517825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.518484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:48.518784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.520151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.522105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.528596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 36/69] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.529288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.544253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.603718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a900a-1ce0-4e64-9251-7083ff841952 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.635014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641291a-c5a2-49e0-8ffc-6c2a88729600 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.641242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.641891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.642173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.642448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] PATH_INFO: `/v3/users/c6fdebe181f0489c9dc30b88531a8eda` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.656538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] RBAC: Authorizing `identity:get_user(user_id=c6fdebe181f0489c9dc30b88531a8eda)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.658007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.659614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 34/70] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/users/c6fdebe181f0489c9dc30b88531a8eda => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.660398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.671145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.671778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.672058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.672349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.682262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:48.687134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:48.688030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 37/71] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:48.688989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.753422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.763537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.766495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e1afb-8db9-495c-90e9-a7c561d1a65a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.789676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559073-bcd6-4086-85c3-f5e4caf025ef None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.800315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.800947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.801222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.801493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.802142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:48.802444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.803814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.811581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 35/72] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.812371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.822676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.823309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.823589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.823867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] PATH_INFO: `/v3/users/1f7b517c3fb74340aafc06f3b489374a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.825031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=1f7b517c3fb74340aafc06f3b489374a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.827002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.828606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 38/73] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/users/1f7b517c3fb74340aafc06f3b489374a => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.829371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.917080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2edb4-be4f-4585-8f5d-0347aaf6f6fe None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.928905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9e2c-5b57-46f5-af32-5f6966b84ea7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:48.950707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.951397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.952185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.952492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.953602 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.955054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.956638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 36/74] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.957400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.963276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:48.963909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:48.964194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:48.964508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:48.965644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:48.967104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:48.968755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 39/75] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:48.969584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:48.979509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:48.981483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.060488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15e62-b992-4579-9dc5-c7bae9e5c0a4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.069727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180feca-5875-47ce-a7be-1556ea38de3f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.098541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.099153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.099431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.099769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.100462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:49.100766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.102156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.103051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.103683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.103962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.104243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] PATH_INFO: `/v3/users/c6fdebe181f0489c9dc30b88531a8eda` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.105412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] RBAC: Authorizing `identity:get_user(user_id=c6fdebe181f0489c9dc30b88531a8eda)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.106832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.108758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 40/76] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/users/c6fdebe181f0489c9dc30b88531a8eda => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:49.109527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.115335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 37/77] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:49.116972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.186589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.198620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.207632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed67e3-cde8-469b-83e0-becbe6e5ed88 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.218403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bec89d-4b2b-4cfe-9442-0576fd36ba49 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.241975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.242605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.242888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.243161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.244305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.245790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.247409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 41/78] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:49 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:49.248171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.251737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.252358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.252653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.252925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.253565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.255003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.276412 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 38/79] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:51:49 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:49.281316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.359494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac085-e8c8-4e1a-a67e-610ddd082365 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.397096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e4c5b-8180-4108-996b-3aa7566a11df None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.398694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.399496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.399777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.400052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92/users/c6fdebe181f0489c9dc30b88531a8eda/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.402163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=20173cdcf21141bd904e931cb78caa92, user_id=c6fdebe181f0489c9dc30b88531a8eda, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.403746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.418873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 42/80] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:49 2022] PUT /identity/v3/projects/20173cdcf21141bd904e931cb78caa92/users/c6fdebe181f0489c9dc30b88531a8eda/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:49.419722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.429837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.454984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.455648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.455934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.456218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] PATH_INFO: `/v3/projects/054f19d1831f4c59a046510d31696e79` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.457445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] RBAC: Authorizing `identity:get_project(project_id=054f19d1831f4c59a046510d31696e79)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.458930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.460878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 39/81] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:49 2022] GET /identity/v3/projects/054f19d1831f4c59a046510d31696e79 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:49.466451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.471240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.559110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41709-e7a3-43c4-b2a1-67771e8f19b7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.611652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad742fca-1ce9-4262-b5f1-96eea007f92c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.614439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.614957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.615244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.615520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] PATH_INFO: `/v3/users/c6fdebe181f0489c9dc30b88531a8eda` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.616723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] RBAC: Authorizing `identity:get_user(user_id=c6fdebe181f0489c9dc30b88531a8eda)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.618242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.619910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 43/82] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:49 2022] GET /identity/v3/users/c6fdebe181f0489c9dc30b88531a8eda => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:49.620828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.660612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.661537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.661816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.663000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92/users/1f7b517c3fb74340aafc06f3b489374a/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.664975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] RBAC: Authorizing `identity:create_grant(project_id=20173cdcf21141bd904e931cb78caa92, user_id=1f7b517c3fb74340aafc06f3b489374a, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.666422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.687054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 40/83] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:49 2022] PUT /identity/v3/projects/20173cdcf21141bd904e931cb78caa92/users/1f7b517c3fb74340aafc06f3b489374a/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:49.688136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:49.710724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.738752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f0be-e5c5-4054-b760-6dba76a81caf None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.781883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.782570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.782848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.783122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] PATH_INFO: `/v3/projects/054f19d1831f4c59a046510d31696e79/users/c6fdebe181f0489c9dc30b88531a8eda/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.785168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] RBAC: Authorizing `identity:create_grant(project_id=054f19d1831f4c59a046510d31696e79, user_id=c6fdebe181f0489c9dc30b88531a8eda, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.786665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.790439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:49.805984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 44/84] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:49 2022] PUT /identity/v3/projects/054f19d1831f4c59a046510d31696e79/users/c6fdebe181f0489c9dc30b88531a8eda/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:49.842803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3de96-7254-4aae-a089-6ea7da97a266 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:49.885080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9804b-0952-4edd-9c2c-58a6fcff51f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:49.885654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9804b-0952-4edd-9c2c-58a6fcff51f8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:49.885934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9804b-0952-4edd-9c2c-58a6fcff51f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:49.886205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9804b-0952-4edd-9c2c-58a6fcff51f8 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:49.887490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9804b-0952-4edd-9c2c-58a6fcff51f8 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:49.889743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9804b-0952-4edd-9c2c-58a6fcff51f8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:49.891428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 41/85] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:49 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:49.897533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:50.048450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed61e2-1c42-42ff-aa02-2c51643b977f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:50.096324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10674cd-4008-4848-91dc-c03f3af7d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:50.098023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10674cd-4008-4848-91dc-c03f3af7d2de None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:50.098524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10674cd-4008-4848-91dc-c03f3af7d2de None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:50.099012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10674cd-4008-4848-91dc-c03f3af7d2de None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92/users/c6fdebe181f0489c9dc30b88531a8eda/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:50.101498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10674cd-4008-4848-91dc-c03f3af7d2de None admin] RBAC: Authorizing `identity:create_grant(project_id=20173cdcf21141bd904e931cb78caa92, user_id=c6fdebe181f0489c9dc30b88531a8eda, role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:50.103163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10674cd-4008-4848-91dc-c03f3af7d2de None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:50.105789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:50.123906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 45/86] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:49 2022] PUT /identity/v3/projects/20173cdcf21141bd904e931cb78caa92/users/c6fdebe181f0489c9dc30b88531a8eda/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:51:52.012912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc4d0-b184-4e9e-8712-5c9954677462 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.013421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc4d0-b184-4e9e-8712-5c9954677462 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.013496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc4d0-b184-4e9e-8712-5c9954677462 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.015541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 42/87] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:52.024540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb51db1-1dc4-44b9-9d90-8947d2f6c672 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.025380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb51db1-1dc4-44b9-9d90-8947d2f6c672 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.025865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb51db1-1dc4-44b9-9d90-8947d2f6c672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.050093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-feb51db1-1dc4-44b9-9d90-8947d2f6c672 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:52.051658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-feb51db1-1dc4-44b9-9d90-8947d2f6c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:52.139643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 46/88] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:52.678423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dc4d0-b184-4e9e-8712-5c9954677462 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:52.774218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63878-5f97-410c-a4cb-e40a1156b1aa None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.774539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63878-5f97-410c-a4cb-e40a1156b1aa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.774786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63878-5f97-410c-a4cb-e40a1156b1aa None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.777037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 47/89] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:52.782293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ef82d-8ff9-46cf-84b1-e23780d5d1d7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.782582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ef82d-8ff9-46cf-84b1-e23780d5d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.783392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ef82d-8ff9-46cf-84b1-e23780d5d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.817923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a59ef82d-8ff9-46cf-84b1-e23780d5d1d7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:52.819437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a59ef82d-8ff9-46cf-84b1-e23780d5d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:52.853063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dc4d0-b184-4e9e-8712-5c9954677462 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:52.912125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:52.921956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:52.922976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.923470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.923933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.937475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 48/90] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:52.939138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b3c5-550d-4009-a037-1066fbf1682c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.944847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b3c5-550d-4009-a037-1066fbf1682c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.948019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11b3c5-550d-4009-a037-1066fbf1682c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.949633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 49/91] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:52.953033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:52.958346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:52.959162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:52.959900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:52.963301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:52.963794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:52.964266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:52.967791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 43/92] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:52.973862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.004966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:53.007711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:53.109910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:53.153842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 50/93] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:53.161163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872f65-a5a0-4b9a-9430-c5c74ab748d8 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:53.215296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:53.215893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.216181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.216478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.217809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:53.218116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:53.219520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4d9cd-3bda-44f1-80cb-b4794eff5ac0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:53.233513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 44/94] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:53.239214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.316274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b18e-87b7-4e7c-a06a-110c464e2083 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.316702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b18e-87b7-4e7c-a06a-110c464e2083 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.316984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b18e-87b7-4e7c-a06a-110c464e2083 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.318421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 45/95] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:53.323814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.324096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.324403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.343464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:53.344802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:53.395228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce9fda-e8d5-45d1-a150-dbf8a215fe3a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:53.421197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:53.431410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822618-10e4-4d8f-bfe1-9575f5fdd854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:53.432047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822618-10e4-4d8f-bfe1-9575f5fdd854 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.432393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822618-10e4-4d8f-bfe1-9575f5fdd854 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.432670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822618-10e4-4d8f-bfe1-9575f5fdd854 None admin] PATH_INFO: `/v3/users/c6fdebe181f0489c9dc30b88531a8eda` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.433788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53822618-10e4-4d8f-bfe1-9575f5fdd854 None admin] RBAC: Authorizing `identity:get_user(user_id=c6fdebe181f0489c9dc30b88531a8eda)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:53.435548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53822618-10e4-4d8f-bfe1-9575f5fdd854 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:53.437218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 51/96] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:53 2022] GET /identity/v3/users/c6fdebe181f0489c9dc30b88531a8eda => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:53.438358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc3bb-1f5c-4855-a252-74a6bb678bb2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.438638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc3bb-1f5c-4855-a252-74a6bb678bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.438908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc3bb-1f5c-4855-a252-74a6bb678bb2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.440241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 52/97] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:53.444515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 46/98] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:51:53.445658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.445836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d06a-90bf-465a-a4b8-83e4d23998f7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.446303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d06a-90bf-465a-a4b8-83e4d23998f7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.446583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d06a-90bf-465a-a4b8-83e4d23998f7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.447846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 53/99] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:53.448897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.449176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.449446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.470366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:53.471475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:53.528919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:53.553288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 54/100] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:53.554042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.572988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c3a3-bb89-4152-ac1e-64a5f5afd95e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:53.616549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5adcf6-1e66-45d8-ab61-e92748135ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:53.617728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5adcf6-1e66-45d8-ab61-e92748135ddb None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.618433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5adcf6-1e66-45d8-ab61-e92748135ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.618908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5adcf6-1e66-45d8-ab61-e92748135ddb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.633667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5adcf6-1e66-45d8-ab61-e92748135ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-cb5adcf6-1e66-45d8-ab61-e92748135ddb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:53.640991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:53.641830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:51:53.642592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:53.645707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 47/101] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:53.647067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.647497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.647899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.672926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:53.674569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:53.677902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc902a1-6ea7-4eac-b25c-7478fcf5ee9f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:53.718217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:53.719058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.719483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.719899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.721818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:53.751075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 48/102] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:53.752118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.786037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:53.809045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:53.810503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:53.865104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f85029-15e3-4159-853f-3a8b71398692 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:53.900234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:53.901130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:53.901585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:53.902060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:53.913707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:53.918275 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 55/103] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:51:53.919110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:53.919804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:53.920719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:51:53.921460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:53.923998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 49/104] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:53.925004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:53.961709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.009270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.028939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694ed91-381d-439a-877c-3c0ee16a2e16 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.034577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8d118-2779-457d-b5ee-31f558122241 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.063038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.063646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.063927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.064204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.064907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:54.065212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.066583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.066951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.067581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.068022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.068300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.074476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 56/105] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.075362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.080718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:54.086037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:54.086946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:54.087730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 50/106] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:51:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:54.089179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.178047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccecc9-0c63-47cc-8f46-7afb7682d634 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.182977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.190534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526e07f-b64d-4100-a0d0-a7cf5dbdc099 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.211983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.212646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.212940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.213195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.214287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.216015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.217592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 57/107] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.218420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.228191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.228866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.229151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.229430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.230560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.232007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.232675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.234028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 51/108] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.235054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.320429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac597b3-8689-4526-9374-82b11505cb18 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.333190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d049-2396-423a-9c3a-42267b68b697 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.352870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.353483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.353766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.354043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.354709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:54.355013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.356399 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.364707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 58/109] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.365497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.370034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.370730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.371016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.371288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.381812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:54.387020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:54.387907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 52/110] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:54.389607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.414285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.447088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.475384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54fb23-08d5-4934-9676-491ede78d8fe None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.488301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6e70-0739-482d-a283-ffe4920a9389 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.507865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.508536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.508819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.509091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] PATH_INFO: `/v3/users/08f08d6a8c074f1ca8060f559045e020` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.521758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.522365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.522648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.522924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.523581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:54.523888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.524046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=08f08d6a8c074f1ca8060f559045e020)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.525307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.525509 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.527118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 59/111] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/users/08f08d6a8c074f1ca8060f559045e020 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.527863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.538711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 53/112] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.540445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.622874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.628294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca9b34-0d96-4416-83a4-133d0491e9d6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.639579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721ab0-2d29-48bd-a2e6-9ff3bbfff962 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.657845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.663112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.663713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.663991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.664264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.664939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.666374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.672900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.673497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.673777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.674047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.674771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] RBAC: Adding query filter params (role.id=3b1990b4aec64813be7704740acbd303, scope.project.id=20173cdcf21141bd904e931cb78caa92, user.id=c6fdebe181f0489c9dc30b88531a8eda) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:54.675078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.676537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.682133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 54/113] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/role_assignments?user.id=c6fdebe181f0489c9dc30b88531a8eda&scope.project.id=20173cdcf21141bd904e931cb78caa92&role.id=3b1990b4aec64813be7704740acbd303 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.682995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.693127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 60/114] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:51:54 2022] POST /identity/v3/projects => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:54.693127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.842810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae947-a008-4dd3-855e-a300e8f82af8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.853112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ebfe-5c0c-4185-b178-32f254a7d82c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:54.889793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.890340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.890622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.890896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.891566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:54.891920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.893541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.902991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:54.904242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:54.904242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:54.904242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] PATH_INFO: `/v3/users/1f7b517c3fb74340aafc06f3b489374a` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:54.905153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 61/115] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.905718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1f7b517c3fb74340aafc06f3b489374a)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:54.905989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.907263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:54.909017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 55/116] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/users/1f7b517c3fb74340aafc06f3b489374a => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:54.910338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:54.933345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:54.967595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.027188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73be2d-a34c-4b8f-a8df-e1640ba50812 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.032988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195325-2788-41e6-8579-c6eb3cc3f2e0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.064914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.065576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.065833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.066108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.067215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.068694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.069667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.070329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 62/117] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:55.070723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.071097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.071503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.071980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] PATH_INFO: `/v3/users/c6fdebe181f0489c9dc30b88531a8eda` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.073367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] RBAC: Authorizing `identity:get_user(user_id=c6fdebe181f0489c9dc30b88531a8eda)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.075968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.082522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 56/118] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:54 2022] GET /identity/v3/users/c6fdebe181f0489c9dc30b88531a8eda => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:55.082522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.170650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.188533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c71c25-4c1f-4613-bf92-bc972ef2bf69 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.190195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6533bb-a104-4166-8089-aa07d6e77603 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.206546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.225135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.225781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.226063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.226344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] PATH_INFO: `/v3/users/c6fdebe181f0489c9dc30b88531a8eda` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.227659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] RBAC: Authorizing `identity:get_user(user_id=c6fdebe181f0489c9dc30b88531a8eda)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.228171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.228813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.229096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.229187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.231137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.231252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 57/119] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:55 2022] GET /identity/v3/users/c6fdebe181f0489c9dc30b88531a8eda => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:55.231550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.302704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.304303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.342186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190ddb2-98bc-49f2-8093-12f4f838bed1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.381786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.382971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.383259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.383540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92/users/08f08d6a8c074f1ca8060f559045e020/roles/9db0e33d47cc40eda3a47f7297ce6273` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.386424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] RBAC: Authorizing `identity:create_grant(project_id=20173cdcf21141bd904e931cb78caa92, user_id=08f08d6a8c074f1ca8060f559045e020, role_id=9db0e33d47cc40eda3a47f7297ce6273)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.388030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.401342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 58/120] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:51:55 2022] PUT /identity/v3/projects/20173cdcf21141bd904e931cb78caa92/users/08f08d6a8c074f1ca8060f559045e020/roles/9db0e33d47cc40eda3a47f7297ce6273 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:51:55.402048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.420739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.433326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 63/121] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:51:55.435550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.461606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.536116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b336f-268d-4218-84d2-84fe92191907 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.570763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b834818-f6ae-4f2c-bdbf-e60b829fbe43 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.591163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.592076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.592889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.592889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.619785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.620459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.620787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.621072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.683712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.686331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.705708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.706774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:55.709001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:55.727325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.828831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 59/122] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:51:55.830134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.840760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 64/123] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:51:55.842616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:55.952911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65655d-8ba5-4264-9a43-fc814affc44b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.964566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d63a3-03d2-4f08-8016-fb2e400f83d6 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:55.968993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.980318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:55.996722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:55.997325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:55.997608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:55.997885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:55.999153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:56.000752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:56.002379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 65/124] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:55 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:56.003149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:56.005263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:56.006117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:56.006606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:56.007089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:56.008508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:56.010146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:56.011953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 60/125] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:55 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:56.012926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:56.143148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292037-c3c3-43aa-b9b8-51985669d53e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:56.145149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397409-d35c-4e15-8d91-1f63341725af None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:56.187529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:56.188521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:56.188913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:56.189447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:56.189884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:56.190195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] RBAC: Adding query filter params (role.id=c4333dc639d7498fbb17ff5eaeac2457, scope.project.id=20173cdcf21141bd904e931cb78caa92, user.id=c6fdebe181f0489c9dc30b88531a8eda) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:56.190609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:56.190974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:56.191657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:56.192067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] PATH_INFO: `/v3/projects/054f19d1831f4c59a046510d31696e79` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:56.192475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:56.193520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] RBAC: Authorizing `identity:get_project(project_id=054f19d1831f4c59a046510d31696e79)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:56.195350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:56.197974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 66/126] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:56 2022] GET /identity/v3/projects/054f19d1831f4c59a046510d31696e79 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:56.198882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:56.199150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 61/127] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:56 2022] GET /identity/v3/role_assignments?user.id=c6fdebe181f0489c9dc30b88531a8eda&scope.project.id=20173cdcf21141bd904e931cb78caa92&role.id=c4333dc639d7498fbb17ff5eaeac2457 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:56.204720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:56.261011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:56.270367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:56.325081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41fa21-c34f-464a-8b75-28545fcbb9ae None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:56.338686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a70f-b584-4e1a-b4ba-1191efa5e6bb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:56.363075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:56.364046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:56.364360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:56.364652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:56.365441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] RBAC: Adding query filter params (role.id=3b1990b4aec64813be7704740acbd303, scope.project.id=054f19d1831f4c59a046510d31696e79, user.id=c6fdebe181f0489c9dc30b88531a8eda) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:56.365762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:56.367707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf02ff-c1aa-440c-af11-7f45346d9791 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:56.377232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 62/128] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:56 2022] GET /identity/v3/role_assignments?user.id=c6fdebe181f0489c9dc30b88531a8eda&scope.project.id=054f19d1831f4c59a046510d31696e79&role.id=3b1990b4aec64813be7704740acbd303 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:51:56.386561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:56.387447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:56.387870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:56.388312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:56.389433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=20173cdcf21141bd904e931cb78caa92, user.id=1f7b517c3fb74340aafc06f3b489374a) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:56.389911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:56.391681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677c41-a566-4432-ba67-6808e60a08ec None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:56.402343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 67/129] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:56 2022] GET /identity/v3/role_assignments?user.id=1f7b517c3fb74340aafc06f3b489374a&scope.project.id=20173cdcf21141bd904e931cb78caa92&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:57.008796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580c39-ff5d-4853-9963-5a2b88203d48 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.009080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580c39-ff5d-4853-9963-5a2b88203d48 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.009356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580c39-ff5d-4853-9963-5a2b88203d48 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.010688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 63/130] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:57.016408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.016761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.017108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.035337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:57.036531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:57.102437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 68/131] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:57.369863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f580c39-ff5d-4853-9963-5a2b88203d48 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:57.468316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f580c39-ff5d-4853-9963-5a2b88203d48 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:57.476838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:57.501939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352c187-6362-47c9-ae55-0148e63579df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:57.502574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c187-6362-47c9-ae55-0148e63579df None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.502858 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c187-6362-47c9-ae55-0148e63579df None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.503138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c187-6362-47c9-ae55-0148e63579df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.504244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352c187-6362-47c9-ae55-0148e63579df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:57.505720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352c187-6362-47c9-ae55-0148e63579df None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:57.507280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 64/132] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:57.512770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:57.556514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:57.612195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8442e-3d1f-4fcd-9da8-8b7978313a2d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:57.646478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e7144-be51-494a-8539-c2de5a22f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:57.647000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e7144-be51-494a-8539-c2de5a22f8dc None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.647277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e7144-be51-494a-8539-c2de5a22f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.647546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e7144-be51-494a-8539-c2de5a22f8dc None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.648189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e7144-be51-494a-8539-c2de5a22f8dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:57.649651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e7144-be51-494a-8539-c2de5a22f8dc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:57.676174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 69/133] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:51:57 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:51:57.709002 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc196-d89c-4f1d-afc5-b13a671616b7 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.709323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc196-d89c-4f1d-afc5-b13a671616b7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.709606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc196-d89c-4f1d-afc5-b13a671616b7 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.711017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 65/134] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:51:57.717567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:57.717854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:57.718133 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:57.737819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:51:57.739090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:51:57.810440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 70/135] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:51:58.078452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afc196-d89c-4f1d-afc5-b13a671616b7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:58.191437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afc196-d89c-4f1d-afc5-b13a671616b7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:58.227182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:58.227838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:58.228154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:58.228498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:58.239746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:51:58.245389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:51:58.246220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:51:58.246966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 66/136] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:51:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:51:58.253059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:58.282919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:58.358416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bcb39-a868-4d8a-be63-608b39e6de28 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:58.398564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:58.399184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:58.399465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:58.399739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:58.400432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:58.400767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:58.402116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:58.410575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 71/137] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:51:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:58.416528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:58.455848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:58.528001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e5c97-ec09-402b-82a8-0509f9a62c73 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:58.564085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:58.564759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:58.565043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:58.565323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] PATH_INFO: `/v3/users/08f08d6a8c074f1ca8060f559045e020` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:58.566486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] RBAC: Authorizing `identity:get_user(user_id=08f08d6a8c074f1ca8060f559045e020)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:58.567956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:58.569957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 67/138] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:51:58 2022] GET /identity/v3/users/08f08d6a8c074f1ca8060f559045e020 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:58.575548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:58.676846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:58.686074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2efa5-452f-4643-9b21-edb03baa6aca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:58.721317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:58.721933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:58.722251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:58.722524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:58.797182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:58.798659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:58.891325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:58.901113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 72/139] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:51:58.907411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:59.018673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acac87-8793-4476-93c1-f9198090dd5c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:59.020937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:51:59.055404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c11304-3e23-4c61-9d33-bcf810c2f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:59.056035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11304-3e23-4c61-9d33-bcf810c2f604 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:59.056394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11304-3e23-4c61-9d33-bcf810c2f604 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:59.056674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11304-3e23-4c61-9d33-bcf810c2f604 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:59.057836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c11304-3e23-4c61-9d33-bcf810c2f604 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:59.059272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c11304-3e23-4c61-9d33-bcf810c2f604 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:59.061472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 68/140] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:51:58 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:59.067877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:51:59.171655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e47b1-4335-4b40-a4b8-f72532a8a4a9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:51:59.206413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:51:59.207020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:59.207303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:59.207579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:59.208304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] RBAC: Adding query filter params (role.id=9db0e33d47cc40eda3a47f7297ce6273, scope.project.id=20173cdcf21141bd904e931cb78caa92, user.id=08f08d6a8c074f1ca8060f559045e020) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:51:59.208641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:51:59.210071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19cc38-8c04-4ad4-8dd1-95e3f47a3a73 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:51:59.216020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 73/141] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:51:59 2022] GET /identity/v3/role_assignments?user.id=08f08d6a8c074f1ca8060f559045e020&scope.project.id=20173cdcf21141bd904e931cb78caa92&role.id=9db0e33d47cc40eda3a47f7297ce6273 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:51:59.983866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58e78-aa3c-4554-974b-b3f221871f92 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:59.984635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58e78-aa3c-4554-974b-b3f221871f92 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:59.984635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58e78-aa3c-4554-974b-b3f221871f92 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:51:59.985914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 69/142] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:51:59.990890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248917c-95ab-49a8-9dca-c23e2d92abea None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:51:59.991264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248917c-95ab-49a8-9dca-c23e2d92abea None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:51:59.991473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248917c-95ab-49a8-9dca-c23e2d92abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.009814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d248917c-95ab-49a8-9dca-c23e2d92abea None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:00.011008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d248917c-95ab-49a8-9dca-c23e2d92abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:00.044719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90abd4-7864-4cd5-a442-3048b9a0fa75 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.045042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90abd4-7864-4cd5-a442-3048b9a0fa75 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.045325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90abd4-7864-4cd5-a442-3048b9a0fa75 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.046813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 70/143] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:00.051601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dc118-2c01-42d3-8966-ba1a04078da6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.051890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dc118-2c01-42d3-8966-ba1a04078da6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.052184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dc118-2c01-42d3-8966-ba1a04078da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.062431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.071833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6c9dc118-2c01-42d3-8966-ba1a04078da6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:00.073159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6c9dc118-2c01-42d3-8966-ba1a04078da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:00.079934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 74/144] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:00.150626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 71/145] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:00.251634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4daa3-7c49-43d9-b56b-e803e75143e9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.251871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4daa3-7c49-43d9-b56b-e803e75143e9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.252295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4daa3-7c49-43d9-b56b-e803e75143e9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.253789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 75/146] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:00.259011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.259301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.259575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.278572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:00.279765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:00.346925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 72/147] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:00.349161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4daa3-7c49-43d9-b56b-e803e75143e9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.416790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.449138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.467217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4daa3-7c49-43d9-b56b-e803e75143e9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.506504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.507062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.507343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.507615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.518144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:00.522080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f37e4c-9637-4ec5-b121-8ff3a2b51d61 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:00.523046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:00.523917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:00.524956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 76/148] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:00.529954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.562525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.563167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.563599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.563884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.575088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:00.579928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:00.580896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:00.581664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 73/149] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:00.583659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.586752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.640233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d13d-2d62-4c01-84d8-094961c41086 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.673207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.673811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.674085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.674358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.675019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:00.675315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.676727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:00.680392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.685064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 77/150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:00.685670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.693888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827138-dbae-4062-97cc-fb197b344172 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.728650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.729257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.729534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.729813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.730481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:00.730777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.732173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:00.740558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 74/151] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:00.741350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.788538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8556d-c3c3-4946-8c88-5266b2325e23 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.797052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.822215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.822837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.823111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.823381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.824501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.825930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:00.828007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 78/152] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:00.828788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.840688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5059-fb08-4858-bb5b-a1037b8a83cc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.874752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.875378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.875654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.875931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] PATH_INFO: `/v3/users/efd3eeb133a247af95cdbb129eb5ad4e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.888553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] RBAC: Authorizing `identity:get_user(user_id=efd3eeb133a247af95cdbb129eb5ad4e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.890627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:00.892207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 75/153] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/users/efd3eeb133a247af95cdbb129eb5ad4e => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:00.892973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.906534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:00.931147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7918-28b1-4b68-9cdf-fc90795c71dd None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:00.964937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:00.965554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:00.965828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:00.966096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] PATH_INFO: `/v3/users/efd3eeb133a247af95cdbb129eb5ad4e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:00.967245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] RBAC: Authorizing `identity:get_user(user_id=efd3eeb133a247af95cdbb129eb5ad4e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:00.968688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:00.970245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 79/154] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/users/efd3eeb133a247af95cdbb129eb5ad4e => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:00.975032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:00.991385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe30fcb-f2ec-4146-9009-9daf6f7fb2ed None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:01.020309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:01.027321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:01.028390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:01.028682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:01.029104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:01.029771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:01.031216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:01.052065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 76/155] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:00 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:01.052827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:01.089978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727695f8-9b1f-43a1-98ab-5285a99e15a4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:01.134057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:01.134637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:01.134855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:01.135083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:01.135411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:01.136859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:01.138464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:01.142136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 80/156] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:00 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:01.148062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:01.178879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684fb9-051d-4189-aa73-88399d189033 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:01.216344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:01.217557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:01.217831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:01.218103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:01.219230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:01.220721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:01.227089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 77/157] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:01 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:01.228109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:01.266618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccb3ba-0c9c-4acd-8143-b2f5ff384017 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:01.281001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:01.311419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5652f-9698-4e89-a399-9663a66af4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:01.312552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5652f-9698-4e89-a399-9663a66af4fc None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:01.312835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5652f-9698-4e89-a399-9663a66af4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:01.313111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5652f-9698-4e89-a399-9663a66af4fc None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/efd3eeb133a247af95cdbb129eb5ad4e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:01.315458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5652f-9698-4e89-a399-9663a66af4fc None admin] RBAC: Authorizing `identity:create_grant(project_id=6b540a171f6e488ba1ae0c6074f6427f, user_id=efd3eeb133a247af95cdbb129eb5ad4e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:01.316958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5652f-9698-4e89-a399-9663a66af4fc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:01.334106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 81/158] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:01 2022] PUT /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/efd3eeb133a247af95cdbb129eb5ad4e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:52:01.343340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c79b-776e-41ca-94bc-42455a2a5fb2 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:01.383418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d1c19-3436-4249-8ca5-ec94a7001cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:01.384092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1c19-3436-4249-8ca5-ec94a7001cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:01.384408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1c19-3436-4249-8ca5-ec94a7001cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:01.384732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1c19-3436-4249-8ca5-ec94a7001cb6 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/efd3eeb133a247af95cdbb129eb5ad4e/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:01.386935 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d1c19-3436-4249-8ca5-ec94a7001cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b540a171f6e488ba1ae0c6074f6427f, user_id=efd3eeb133a247af95cdbb129eb5ad4e, role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:01.389263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d1c19-3436-4249-8ca5-ec94a7001cb6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:01.392946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:01.410243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 78/159] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:01 2022] PUT /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/efd3eeb133a247af95cdbb129eb5ad4e/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:03.365906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bced6-e3ef-450e-8148-f721f064e2bf None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.366412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bced6-e3ef-450e-8148-f721f064e2bf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.366412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bced6-e3ef-450e-8148-f721f064e2bf None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.367895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 82/160] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:03.373732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4af6-8f20-4b1e-bfef-5a9e47c490c9 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.374545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4af6-8f20-4b1e-bfef-5a9e47c490c9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.375034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b4af6-8f20-4b1e-bfef-5a9e47c490c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.393660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a96b4af6-8f20-4b1e-bfef-5a9e47c490c9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:03.395154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a96b4af6-8f20-4b1e-bfef-5a9e47c490c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:03.434243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37611568-23e7-408b-bf16-a623c1b11468 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.434885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37611568-23e7-408b-bf16-a623c1b11468 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.435393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37611568-23e7-408b-bf16-a623c1b11468 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.437442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 83/161] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:03.443318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15882-efcd-4009-ad84-1acccd218eaf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.443933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15882-efcd-4009-ad84-1acccd218eaf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.444437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15882-efcd-4009-ad84-1acccd218eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.465505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d7c15882-efcd-4009-ad84-1acccd218eaf None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:03.467953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d7c15882-efcd-4009-ad84-1acccd218eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:03.477275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 79/162] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:03.548072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 84/163] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:03.559926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67675-de1f-4b5c-83b5-8eb46ac4003a None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.560432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67675-de1f-4b5c-83b5-8eb46ac4003a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.561018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b67675-de1f-4b5c-83b5-8eb46ac4003a None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.562567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 80/164] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:03.569621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.569908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.570179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.588668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:03.589854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:03.611873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44c38-a12b-45f9-8c15-2f83c3035c4b None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.612140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44c38-a12b-45f9-8c15-2f83c3035c4b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.612444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44c38-a12b-45f9-8c15-2f83c3035c4b None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.613902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 81/165] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:03.618703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.618927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.619203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.637418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:03.638594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:03.664367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 85/166] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:03.711961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 82/167] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:03.780238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:03.814806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:03.843750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:03.891986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537f61-f8c2-4922-8f23-4c12f1f9ccf7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:03.906513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:03.929025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:03.929659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:03.929937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:03.930215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:03.941625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:03.946766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:03.947680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:03.948497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 86/168] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:03.949571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:03.961068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a37ef-1448-420d-92c7-762aa4d18a32 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:03.999439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.000074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.000378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.000644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.001745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.003180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.004950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 83/169] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.005525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.048125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.057478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5483-aecb-4175-bc5d-87453818f668 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.090254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.090883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.091162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.091434 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.102487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:04.106754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff441b3-9563-43df-b321-331d5d31a29a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:04.107313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:04.109064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:04.109874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 87/170] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:04.110508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.133678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.144808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.145353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.145629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.145901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.146558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:04.146860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.148222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.156612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 84/171] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.161084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.208219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63121-9d68-4832-833c-37aa55ffc319 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.241985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.242584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.242862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.243137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.243801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.245263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.254476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185cb4-1136-47d9-b7d8-4ae8d67f80c1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.266345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 88/172] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:04 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:04.267200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.278953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.309349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.310055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.310344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.310798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.323829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:04.330006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:04.330975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:04.332906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 85/173] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:04.337255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.387830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852551b-0d12-4232-8d43-e14691c80f32 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.391849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.428559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.429419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.429684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.430120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.430832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:04.431137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.433135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.441894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 89/174] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.446169 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.454308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326327b-898b-4b9f-849d-c422e9cf368a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.496139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.497158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.497613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.497871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] PATH_INFO: `/v3/users/795660b60bd94fb29d977dee7c086048` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.513109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=795660b60bd94fb29d977dee7c086048)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.515134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.516841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 86/175] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/users/795660b60bd94fb29d977dee7c086048 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.517658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.528926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.573533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb625-aabc-4ddb-aac0-86e7f3577158 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.620754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.621233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.621512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.621786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.622799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:04.623729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.625359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.636717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 90/176] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.637024 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.647476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198779-4b9a-4624-95b0-29fff0ede7b7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.651980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.691272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.691821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.692098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.692393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] PATH_INFO: `/v3/users/efd3eeb133a247af95cdbb129eb5ad4e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.693973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] RBAC: Authorizing `identity:get_user(user_id=efd3eeb133a247af95cdbb129eb5ad4e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.695808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.698032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 87/177] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/users/efd3eeb133a247af95cdbb129eb5ad4e => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.698890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.774159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead4538-21b8-440c-9819-493f28bc895a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.815007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.823340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.823982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.824516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.825060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.827158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.828629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.829319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e18a9-1c81-412b-a5e0-b10829fa95ca None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:04.830339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 91/178] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.831369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.878568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:04.879210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:04.879487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:04.879755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] PATH_INFO: `/v3/users/efd3eeb133a247af95cdbb129eb5ad4e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:04.881023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] RBAC: Authorizing `identity:get_user(user_id=efd3eeb133a247af95cdbb129eb5ad4e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:04.883286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:04.885171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 88/179] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/users/efd3eeb133a247af95cdbb129eb5ad4e => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:04.885925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:04.940118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:04.959981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0ac76-7f84-4083-a648-6c34613e7cf9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.006636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.007529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.007830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.008505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.014620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322a139-c55f-4ace-8948-f3c313ce2724 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.050441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.051393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.051769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.052171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/795660b60bd94fb29d977dee7c086048/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.054192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b540a171f6e488ba1ae0c6074f6427f, user_id=795660b60bd94fb29d977dee7c086048, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.055709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.069215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 89/180] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:04 2022] PUT /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/795660b60bd94fb29d977dee7c086048/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:05.070128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:05.105633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:05.112090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.113591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.241911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:05.250550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae7c3-e3b5-4008-89bb-daec47bf2e07 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.308785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 92/181] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:05.316295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:05.334081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.334699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.335234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.335503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.436039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.438191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.447795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:05.453255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9176c-b83b-44fb-bc03-57d2c31e34ad None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.515237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.515795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.516068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.516354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.523468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.524953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.530906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 93/182] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:05 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:05.536607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:05.615998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:05.620241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 90/183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:05.627020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:05.649129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b1295-628a-4d9f-89d1-8b6e354e971e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.733429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.734051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.734327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.734593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.735413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=6b540a171f6e488ba1ae0c6074f6427f, user.id=efd3eeb133a247af95cdbb129eb5ad4e) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:05.735718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.737260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.743559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9e80-269e-4d7d-80f0-dd7b1217e1ae None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.752940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 94/184] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:05 2022] GET /identity/v3/role_assignments?user.id=efd3eeb133a247af95cdbb129eb5ad4e&scope.project.id=6b540a171f6e488ba1ae0c6074f6427f&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:05.782094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c1a3-8b7c-4da0-acdc-5b2309df6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.782670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c1a3-8b7c-4da0-acdc-5b2309df6347 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.782951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c1a3-8b7c-4da0-acdc-5b2309df6347 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.783226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c1a3-8b7c-4da0-acdc-5b2309df6347 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.784411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c1a3-8b7c-4da0-acdc-5b2309df6347 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.785910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c1a3-8b7c-4da0-acdc-5b2309df6347 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.787753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 91/185] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:05 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:05.793886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:05.840556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:05.931781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073bf0-cc0c-49ab-a65e-13eb72438820 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:05.984958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:05.985583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:05.985869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:05.986141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:05.986883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] RBAC: Adding query filter params (role.id=c4333dc639d7498fbb17ff5eaeac2457, scope.project.id=6b540a171f6e488ba1ae0c6074f6427f, user.id=efd3eeb133a247af95cdbb129eb5ad4e) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:05.987192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:05.988685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ab50-6215-45b0-bc30-3ffedcd8fb9d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:05.995229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 95/186] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:05 2022] GET /identity/v3/role_assignments?user.id=efd3eeb133a247af95cdbb129eb5ad4e&scope.project.id=6b540a171f6e488ba1ae0c6074f6427f&role.id=c4333dc639d7498fbb17ff5eaeac2457 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:06.673439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2a97-9cfa-45e1-8e64-131aaa7c7ccc None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.673963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2a97-9cfa-45e1-8e64-131aaa7c7ccc None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.673963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2a97-9cfa-45e1-8e64-131aaa7c7ccc None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.675321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 92/187] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:06.680622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ebea1-e1b6-46f1-86d6-c8d68bd789d3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.681064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ebea1-e1b6-46f1-86d6-c8d68bd789d3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.681166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ebea1-e1b6-46f1-86d6-c8d68bd789d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.700123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-288ebea1-e1b6-46f1-86d6-c8d68bd789d3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:06.701369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-288ebea1-e1b6-46f1-86d6-c8d68bd789d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:06.772004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 96/188] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:06.868528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6478a-7050-4b34-86cd-83b646362f9f None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.868882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6478a-7050-4b34-86cd-83b646362f9f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.869078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6478a-7050-4b34-86cd-83b646362f9f None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.870540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 93/189] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:06.876043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:06.876347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:06.876604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:06.895296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:06.896474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:06.916183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:06.963397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 97/190] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:07.044954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6478a-7050-4b34-86cd-83b646362f9f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.120782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.157847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6478a-7050-4b34-86cd-83b646362f9f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.193847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.194784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.195240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.195686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.206402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:07.211627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:07.212552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:07.213358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:07.214039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 94/191] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:07.220706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.235153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.328645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d7125-b019-4db7-a3f5-a77090e19e51 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.339608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e467a8-f731-4287-8ea1-f67576dcc823 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.365242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.365857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.366134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.366408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.367243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:07.367680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.367853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.369525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.375870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.376537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.376813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.377080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.378178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.379620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.380158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 98/192] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:07.381320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 95/193] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:07.385801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.386307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.407494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.495943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f071-c9bf-427d-bdea-2e2845a919ca None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.496138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5c61-b81a-4862-bb45-f6f8be40aa12 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.530602 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db2a55-7e07-4199-8640-a104021eb8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.530797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07574f62-0795-489a-9990-a6ca79c2666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.531284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2a55-7e07-4199-8640-a104021eb8bd None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.531407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07574f62-0795-489a-9990-a6ca79c2666b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.531559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2a55-7e07-4199-8640-a104021eb8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.531649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07574f62-0795-489a-9990-a6ca79c2666b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.531828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db2a55-7e07-4199-8640-a104021eb8bd None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.531921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07574f62-0795-489a-9990-a6ca79c2666b None admin] PATH_INFO: `/v3/users/662943c683c245489517f9d394ee9d23` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.532496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db2a55-7e07-4199-8640-a104021eb8bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.533937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db2a55-7e07-4199-8640-a104021eb8bd None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.546538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07574f62-0795-489a-9990-a6ca79c2666b None admin] RBAC: Authorizing `identity:get_user(user_id=662943c683c245489517f9d394ee9d23)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.547997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07574f62-0795-489a-9990-a6ca79c2666b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.550103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 99/194] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/users/662943c683c245489517f9d394ee9d23 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:07.551089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596afb8-4d75-4355-9cda-c968f2e44ad1 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.551369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596afb8-4d75-4355-9cda-c968f2e44ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.551636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596afb8-4d75-4355-9cda-c968f2e44ad1 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.552984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 100/195] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:07.555177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596afb8-4d75-4355-9cda-c968f2e44ad1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.560379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 96/196] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:07 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:52:07.560379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.560379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.560379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.584755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:07.586104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:07.641500 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.649315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:07.668246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 97/197] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:07.679928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596afb8-4d75-4355-9cda-c968f2e44ad1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.719491 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.720263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.720503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.720769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.721919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.723380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.725073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 101/198] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:07.730921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:07.838785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6aba3-5e34-4c62-b8ec-8b3106aff3b5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:07.879384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:07.880054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:07.880328 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:07.880641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/662943c683c245489517f9d394ee9d23/roles/9db0e33d47cc40eda3a47f7297ce6273` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:07.882513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] RBAC: Authorizing `identity:create_grant(project_id=6b540a171f6e488ba1ae0c6074f6427f, user_id=662943c683c245489517f9d394ee9d23, role_id=9db0e33d47cc40eda3a47f7297ce6273)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:07.883962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:07.898275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 98/199] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:07 2022] PUT /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/users/662943c683c245489517f9d394ee9d23/roles/9db0e33d47cc40eda3a47f7297ce6273 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:07.938704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:08.051180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b457ca-dcc4-4cdc-941d-b4ff5dd0385b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:08.088578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:08.089290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:08.089563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:08.093343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:08.109808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:08.114872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:08.115788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:08.116628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 102/200] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:08.125435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:08.172066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:08.231106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac003d-9233-4876-933c-d6e42e7dd2fa None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:08.272743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:08.273701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:08.274209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:08.274711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:08.275390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] RBAC: Adding query filter params (name=member) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:08.275695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:08.277112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:08.285931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 99/201] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:08.291714 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:08.296713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:08.402138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeef08-cdd5-4d5c-a63c-6ea44043a62b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:08.446298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0304893-f82e-4738-816a-53362b1402af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:08.446933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0304893-f82e-4738-816a-53362b1402af None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:08.447208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0304893-f82e-4738-816a-53362b1402af None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:08.447478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0304893-f82e-4738-816a-53362b1402af None admin] PATH_INFO: `/v3/users/795660b60bd94fb29d977dee7c086048` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:08.448656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0304893-f82e-4738-816a-53362b1402af None admin] RBAC: Authorizing `identity:get_user(user_id=795660b60bd94fb29d977dee7c086048)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:08.450093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0304893-f82e-4738-816a-53362b1402af None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:08.451925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 103/202] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:08 2022] GET /identity/v3/users/795660b60bd94fb29d977dee7c086048 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:08.457292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:08.560278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac458c82-3d74-48a0-a197-fdfca6196870 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:08.562794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:08.595510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:08.596116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:08.596418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:08.596693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:08.669341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:08.671331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:08.777981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 100/203] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:08.784104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0304893-f82e-4738-816a-53362b1402af None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:08.854871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:08.885123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0304893-f82e-4738-816a-53362b1402af None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:08.925801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7690ec-aa89-449b-bfae-01cf729cb628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:08.926339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7690ec-aa89-449b-bfae-01cf729cb628 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:08.926617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7690ec-aa89-449b-bfae-01cf729cb628 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:08.926884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7690ec-aa89-449b-bfae-01cf729cb628 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:08.928001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7690ec-aa89-449b-bfae-01cf729cb628 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:08.929471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7690ec-aa89-449b-bfae-01cf729cb628 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:08.931304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 104/204] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:08 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:08.937004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:08.940149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:09.037878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54927e01-5853-4c2a-9e3a-39996a6f6143 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:09.078429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:09.079040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:09.079360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:09.079585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:09.080307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] RBAC: Adding query filter params (role.id=3b1990b4aec64813be7704740acbd303, scope.project.id=6b540a171f6e488ba1ae0c6074f6427f, user.id=795660b60bd94fb29d977dee7c086048) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:09.080662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:09.082374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac72d85-ff10-424d-8d5a-9cf42d7a7dad None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:09.088812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 101/205] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:08 2022] GET /identity/v3/role_assignments?user.id=795660b60bd94fb29d977dee7c086048&scope.project.id=6b540a171f6e488ba1ae0c6074f6427f&role.id=3b1990b4aec64813be7704740acbd303 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:09.983821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42408cbc-ac06-462c-86f7-39dda13f2d00 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:09.984357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42408cbc-ac06-462c-86f7-39dda13f2d00 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:09.984357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42408cbc-ac06-462c-86f7-39dda13f2d00 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:09.985854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 105/206] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:09.990803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b569-b18e-45d1-8f2f-b7df0c7eb929 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:09.991175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b569-b18e-45d1-8f2f-b7df0c7eb929 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:09.991335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b569-b18e-45d1-8f2f-b7df0c7eb929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.009297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c778b569-b18e-45d1-8f2f-b7df0c7eb929 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:10.010467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c778b569-b18e-45d1-8f2f-b7df0c7eb929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:10.012908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce6e9-97d6-4f1f-8cb0-7950a8185a56 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.013195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce6e9-97d6-4f1f-8cb0-7950a8185a56 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.014389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce6e9-97d6-4f1f-8cb0-7950a8185a56 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.015868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 106/207] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:10.021458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdac3a-d1be-42af-94d4-9bb80fd20cfa None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.022075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdac3a-d1be-42af-94d4-9bb80fd20cfa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.022483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdac3a-d1be-42af-94d4-9bb80fd20cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.040367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d9bdac3a-d1be-42af-94d4-9bb80fd20cfa None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:10.041557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d9bdac3a-d1be-42af-94d4-9bb80fd20cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:10.075423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:10.088400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 102/208] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:10.122323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 107/209] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:10.195678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54c02-de50-40ae-820c-1369062b67ff None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.195982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54c02-de50-40ae-820c-1369062b67ff None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.196239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54c02-de50-40ae-820c-1369062b67ff None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.197748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 103/210] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:10.202875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.203162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.203430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.222273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:10.223517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:10.289307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:10.296650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 108/211] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:10.349915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54c02-de50-40ae-820c-1369062b67ff None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.392424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.453636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54c02-de50-40ae-820c-1369062b67ff None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:10.488382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:10.489038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.489293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.489568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.490644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:10.492068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:10.493789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 104/212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:10.497577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310965-3674-4267-8f0e-725e98aa6bab None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:10.498890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.534643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:10.536036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.536326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.536621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.548236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:10.553972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:10.554829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:10.555693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:10.560318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 109/213] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:10.561660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.567393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:10.602785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4eb1-94c0-4b59-a306-6561a76ac2f4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:10.620240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:10.635769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:10.636456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.636737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.637022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.637647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:10.639672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:10.659259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 105/214] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:10 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:52:10.661945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d15f-13c7-4d18-9688-63e20a4ccfde None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:10.665340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.704527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:10.705140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.705444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.705675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.706868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:10.706868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:10.708009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:10.717853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 110/215] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:10.723481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.785511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03b2b8-8621-4990-9bbd-ff222b3eda16 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:10.814005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:10.829625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:10.830261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.830540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.830808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.839416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e987ba-d398-4404-b098-e29e2cfc6e52 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:10.843047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:10.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:10.849672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:10.850471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:10.854785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 106/216] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:10.855814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.867593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:10.883439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:10.884067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:10.884365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:10.884638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] PATH_INFO: `/v3/users/adc1b04c66c84106b275602dcb721b7e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:10.899983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] RBAC: Authorizing `identity:get_user(user_id=adc1b04c66c84106b275602dcb721b7e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:10.901487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:10.903143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 111/217] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/users/adc1b04c66c84106b275602dcb721b7e => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:10.910112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:10.975603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56e8e-f16e-4363-8548-629fa3ffc32c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:11.015579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:11.016192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:11.016495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:11.016767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:11.017432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:11.017739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:11.019104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:11.027558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 107/218] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:11.033808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:11.034372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2121a-e613-4734-bf84-7ab05a9c97fb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:11.073685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:11.074577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:11.075530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:11.075987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:11.077475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] RBAC: Adding query filter params (role.id=3b1990b4aec64813be7704740acbd303, user.id=adc1b04c66c84106b275602dcb721b7e, scope.system=all) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:11.078307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:11.080579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:11.082045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:11.087598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 112/219] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Oct 26 10:52:10 2022] GET /identity/v3/role_assignments?user.id=adc1b04c66c84106b275602dcb721b7e&scope.system=all&role.id=3b1990b4aec64813be7704740acbd303 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:11.148175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d0c2-cbc8-45af-9484-957509d35cf7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:11.187604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:11.188261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:11.188569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:11.188847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] PATH_INFO: `/v3/users/662943c683c245489517f9d394ee9d23` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:11.190025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] RBAC: Authorizing `identity:get_user(user_id=662943c683c245489517f9d394ee9d23)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:11.191511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:11.193195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 108/220] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:11 2022] GET /identity/v3/users/662943c683c245489517f9d394ee9d23 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:11.199296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:11.253053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:11.317322 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbe397-9bc5-4b38-a03c-6a1d92b193dc None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:11.353452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:11.354062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:11.354339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:11.354612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:11.428791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:11.430280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:11.475809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:11.532390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 113/221] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:11.537926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:11.645381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da848754-3c1d-48cc-855c-7dc9d5c529e2 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:11.658834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:11.680649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5f0ac-8aea-4631-be93-e7da2b694e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:11.681353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5f0ac-8aea-4631-be93-e7da2b694e01 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:11.682090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5f0ac-8aea-4631-be93-e7da2b694e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:11.682372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5f0ac-8aea-4631-be93-e7da2b694e01 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:11.683507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5f0ac-8aea-4631-be93-e7da2b694e01 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:11.685012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5f0ac-8aea-4631-be93-e7da2b694e01 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:11.691019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 109/222] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:11 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:11.693621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:11.857340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3142b30-4bc0-4ed9-9aab-e93f9614f68e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:11.893555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:11.894180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:11.894453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:11.894717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:11.895494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] RBAC: Adding query filter params (role.id=9db0e33d47cc40eda3a47f7297ce6273, scope.project.id=6b540a171f6e488ba1ae0c6074f6427f, user.id=662943c683c245489517f9d394ee9d23) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:11.895744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:11.897201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0347e9-747f-4112-9416-52a5dbb44f8d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:11.903381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 114/223] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:11 2022] GET /identity/v3/role_assignments?user.id=662943c683c245489517f9d394ee9d23&scope.project.id=6b540a171f6e488ba1ae0c6074f6427f&role.id=9db0e33d47cc40eda3a47f7297ce6273 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:13.044572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cfb3-8612-4b01-b7df-020cf0106d78 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.045123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cfb3-8612-4b01-b7df-020cf0106d78 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.045202 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cfb3-8612-4b01-b7df-020cf0106d78 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.048362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 110/224] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:13.051742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8cbe-8231-4cc9-9221-f20ee9ea0bdf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.052174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8cbe-8231-4cc9-9221-f20ee9ea0bdf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.052484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe8cbe-8231-4cc9-9221-f20ee9ea0bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.070954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-26fe8cbe-8231-4cc9-9221-f20ee9ea0bdf None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:13.072148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-26fe8cbe-8231-4cc9-9221-f20ee9ea0bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:13.074149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:13.115616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5390-4289-4649-911f-6a6ce12e3489 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.115901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5390-4289-4649-911f-6a6ce12e3489 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.116179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5390-4289-4649-911f-6a6ce12e3489 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.117566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 111/225] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:52:13.122643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bd2ec-a801-4bf2-aeac-7e817b9e6986 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.122928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bd2ec-a801-4bf2-aeac-7e817b9e6986 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.123747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bd2ec-a801-4bf2-aeac-7e817b9e6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.144852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-660bd2ec-a801-4bf2-aeac-7e817b9e6986 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:13.146351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-660bd2ec-a801-4bf2-aeac-7e817b9e6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:13.153739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 115/226] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:13.218176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 112/227] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:13.382328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0bab-26d1-446f-9276-501a029f354b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.382708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0bab-26d1-446f-9276-501a029f354b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.382881 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0bab-26d1-446f-9276-501a029f354b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.384249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 116/228] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:13.389391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.389680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.389938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.407592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:13.408786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:13.422874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0bab-26d1-446f-9276-501a029f354b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.478074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 113/229] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:13.494852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.532480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0bab-26d1-446f-9276-501a029f354b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:13.540405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:13.573963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:13.574891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.575411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.575880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.584253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:13.587483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:13.592797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:13.593694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:13.594495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:13.598761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 117/230] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:13.599615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.606282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233432c0-d002-4b28-9548-bb5bb09c5d46 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:13.642730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:13.643288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.643568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.643847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.645007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:13.646450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:13.648188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 114/231] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:13.653487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.707310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b7c68-5f95-4548-9073-4e1bc800b4a3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:13.743723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:13.744343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.744630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.744899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.745558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:13.745863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:13.747239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:13.755258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 118/232] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:13.756039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.762843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc775-62dd-44a6-b940-3cfdf55dc34f None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:13.772309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:13.797671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:13.798269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.798543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.798807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] PATH_INFO: `/v3/groups` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.799421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:13.800884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:13.813931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:13.815632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 115/233] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Oct 26 10:52:13 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:13.821395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.859814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6ccb4-fff4-4660-9416-0b9723c25d17 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:13.903141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:13.903846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.904121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.904960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:13.916998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:13.923424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:13.924692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:13.925699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 119/234] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:13.930600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:13.946842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b977ab-facc-4897-b716-544d14f39ac0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:13.984525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:13.985165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:13.985442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:13.985715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] PATH_INFO: `/v3/users/ee55dfdf30b24adc84be293d06c56720` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:14.002903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] RBAC: Authorizing `identity:get_user(user_id=ee55dfdf30b24adc84be293d06c56720)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:14.004015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:14.005710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 116/235] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:13 2022] GET /identity/v3/users/ee55dfdf30b24adc84be293d06c56720 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:14.011373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:14.040643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:14.045838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373b12-5b15-4030-ad19-c4ff70599a1c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:14.067797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:14.083883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:14.085188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:14.085474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:14.085902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:14.086569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:14.086876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:14.088635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:14.105516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 120/236] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:14.106882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:14.127892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea227b-6d24-4b23-ac72-9687ef7953e9 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:14.166420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:14.166951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:14.167225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:14.167494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:14.168317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] RBAC: Adding query filter params (role.id=9db0e33d47cc40eda3a47f7297ce6273, user.id=ee55dfdf30b24adc84be293d06c56720, scope.system=all) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:14.168646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:14.170237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:14.175971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 117/237] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Oct 26 10:52:14 2022] GET /identity/v3/role_assignments?user.id=ee55dfdf30b24adc84be293d06c56720&scope.system=all&role.id=9db0e33d47cc40eda3a47f7297ce6273 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:14.212921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e00f-ae92-4d13-ae61-b4ef4f17efbc None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:14.250197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050e72-f7fc-4aa5-874e-2e8e864ee8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:14.251193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050e72-f7fc-4aa5-874e-2e8e864ee8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:14.251658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050e72-f7fc-4aa5-874e-2e8e864ee8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:14.252100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050e72-f7fc-4aa5-874e-2e8e864ee8d5 None admin] PATH_INFO: `/v3/users/adc1b04c66c84106b275602dcb721b7e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:14.253523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050e72-f7fc-4aa5-874e-2e8e864ee8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=adc1b04c66c84106b275602dcb721b7e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:14.255237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050e72-f7fc-4aa5-874e-2e8e864ee8d5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:14.257144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 121/238] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:14 2022] GET /identity/v3/users/adc1b04c66c84106b275602dcb721b7e => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:14.263110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:14.366704 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:14.377589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360b83-b253-44d7-aaff-b4b2dad5960e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:14.413048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358a2bf-9ff7-4b70-b110-3c8b4908b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:14.413743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358a2bf-9ff7-4b70-b110-3c8b4908b6f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:14.414052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358a2bf-9ff7-4b70-b110-3c8b4908b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:14.414293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358a2bf-9ff7-4b70-b110-3c8b4908b6f4 None admin] PATH_INFO: `/v3/system/users/adc1b04c66c84106b275602dcb721b7e/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:14.415680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358a2bf-9ff7-4b70-b110-3c8b4908b6f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=adc1b04c66c84106b275602dcb721b7e, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:14.417123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358a2bf-9ff7-4b70-b110-3c8b4908b6f4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:14.427370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 118/239] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Oct 26 10:52:14 2022] PUT /identity/v3/system/users/adc1b04c66c84106b275602dcb721b7e/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:16.006726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f218cd2-1e6d-4751-95e5-5383cc3abaf6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.007245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f218cd2-1e6d-4751-95e5-5383cc3abaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.007245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f218cd2-1e6d-4751-95e5-5383cc3abaf6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.008673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 122/240] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:16.014318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9420e-9044-418c-8f58-3e49c5d68385 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.014691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9420e-9044-418c-8f58-3e49c5d68385 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.014867 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9420e-9044-418c-8f58-3e49c5d68385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.032792 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f2a9420e-9044-418c-8f58-3e49c5d68385 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:16.033974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f2a9420e-9044-418c-8f58-3e49c5d68385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:16.103961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 119/241] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:16.311988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365126-a401-4557-9962-3a1311af3557 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.312319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365126-a401-4557-9962-3a1311af3557 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.312514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365126-a401-4557-9962-3a1311af3557 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.313947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 123/242] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:16.318930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.319216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.319486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.337355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:16.338517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:16.372843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365126-a401-4557-9962-3a1311af3557 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:16.408730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 120/243] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:16.431363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:16.487840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365126-a401-4557-9962-3a1311af3557 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:16.521386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e036f5-4616-4dfb-9a02-cf2b66a273a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:16.522007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e036f5-4616-4dfb-9a02-cf2b66a273a5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.522278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e036f5-4616-4dfb-9a02-cf2b66a273a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.522547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e036f5-4616-4dfb-9a02-cf2b66a273a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.523614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e036f5-4616-4dfb-9a02-cf2b66a273a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:16.525066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e036f5-4616-4dfb-9a02-cf2b66a273a5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:16.526772 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 124/244] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:16.532138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:16.548220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:16.571097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e5761-5e77-425d-863f-5cc7f124dc5a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.571299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e5761-5e77-425d-863f-5cc7f124dc5a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.571565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e5761-5e77-425d-863f-5cc7f124dc5a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.573063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 125/245] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:16.577773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737764-ec00-460c-ab17-470677334f4e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.578051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737764-ec00-460c-ab17-470677334f4e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.578320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737764-ec00-460c-ab17-470677334f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.596044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b8737764-ec00-460c-ab17-470677334f4e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:16.597233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b8737764-ec00-460c-ab17-470677334f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:16.638424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbba78-ce27-41ba-b89e-bf5e34590c54 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:16.667161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 126/246] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:16.673493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:16.674112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.674375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.674643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] PATH_INFO: `/v3/groups` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.675236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737764-ec00-460c-ab17-470677334f4e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:16.675333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:16.676716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:16.700365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 121/247] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Oct 26 10:52:16 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:16.736243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:16.793840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737764-ec00-460c-ab17-470677334f4e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:16.831408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:16.832051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:16.832325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:16.832620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:16.844474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:16.849525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:16.850440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:16.851216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 127/248] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:16.856562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:16.936242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:16.938135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:16.972718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb0f1-430b-4e00-aa58-1f609269fca0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.013306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.015470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.015470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.015470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.016093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:17.016272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:17.017616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:17.028893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 122/249] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:17.037432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:17.075390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2e8d0-e388-4d34-a779-8d27fdbc7508 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.086654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:17.119945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.120612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.120909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.121148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.132409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:17.137486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:17.138339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:17.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 128/250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:17.144953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:17.184875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da346a96-b97a-4e75-b715-29fbcf724f5b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.230880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.231988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.233671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.233783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] PATH_INFO: `/v3/users/ee55dfdf30b24adc84be293d06c56720` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.237045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] RBAC: Authorizing `identity:get_user(user_id=ee55dfdf30b24adc84be293d06c56720)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:17.239279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:17.241471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 123/251] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:17 2022] GET /identity/v3/users/ee55dfdf30b24adc84be293d06c56720 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:17.249694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:17.262847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:17.275647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac2e49-64e0-4ecd-8929-906b44807f0b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.320280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.320931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.321325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.321600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.322264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:17.322564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:17.323946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:17.334729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 129/252] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:17.340216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:17.382559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:17.389044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd931b91-985e-4bbb-b582-4af8590259e9 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.442205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.442910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.443191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.443468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] PATH_INFO: `/v3/system/users/ee55dfdf30b24adc84be293d06c56720/roles/9db0e33d47cc40eda3a47f7297ce6273` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.446072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ee55dfdf30b24adc84be293d06c56720, role_id=9db0e33d47cc40eda3a47f7297ce6273)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:17.447570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:17.459901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 124/253] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Oct 26 10:52:17 2022] PUT /identity/v3/system/users/ee55dfdf30b24adc84be293d06c56720/roles/9db0e33d47cc40eda3a47f7297ce6273 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:17.486146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf8d0e-3511-40f5-840d-a29e13f9a3ed None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.526226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e76ce-efb4-4031-8b21-04be6cf38082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.527311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e76ce-efb4-4031-8b21-04be6cf38082 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.527795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e76ce-efb4-4031-8b21-04be6cf38082 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.528283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e76ce-efb4-4031-8b21-04be6cf38082 None admin] PATH_INFO: `/v3/users/adc1b04c66c84106b275602dcb721b7e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.530389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e76ce-efb4-4031-8b21-04be6cf38082 None admin] RBAC: Authorizing `identity:get_user(user_id=adc1b04c66c84106b275602dcb721b7e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:17.532183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e76ce-efb4-4031-8b21-04be6cf38082 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:17.534408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 130/254] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:17 2022] GET /identity/v3/users/adc1b04c66c84106b275602dcb721b7e => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:17.540107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:17.647992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:17.688640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26cf52-4271-4038-aad4-84729c60935d None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:17.727422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:17.728032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:17.728315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:17.728659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:17.729399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] RBAC: Adding query filter params (role.id=3b1990b4aec64813be7704740acbd303, user.id=adc1b04c66c84106b275602dcb721b7e, scope.system=all) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:17.729708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:17.731194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c08896-56ba-41df-9c6f-a6f45660decc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:17.747026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 125/255] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Oct 26 10:52:17 2022] GET /identity/v3/role_assignments?user.id=adc1b04c66c84106b275602dcb721b7e&scope.system=all&role.id=3b1990b4aec64813be7704740acbd303 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:19.368306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469d46-70d3-488e-bbd8-d5f4fa148637 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:19.368906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469d46-70d3-488e-bbd8-d5f4fa148637 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:19.368906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469d46-70d3-488e-bbd8-d5f4fa148637 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:19.370383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 131/256] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:19.394779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721763-2509-4d14-9e4f-c5d002d9a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:19.395320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721763-2509-4d14-9e4f-c5d002d9a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:19.395320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e721763-2509-4d14-9e4f-c5d002d9a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:19.425620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-4e721763-2509-4d14-9e4f-c5d002d9a9e7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:19.426893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4e721763-2509-4d14-9e4f-c5d002d9a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:19.499089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 126/257] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:52:19.554230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf166-71ec-4eca-a4c6-51ae282dc70c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:19.554578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf166-71ec-4eca-a4c6-51ae282dc70c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:19.554863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf166-71ec-4eca-a4c6-51ae282dc70c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:19.556368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 132/258] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:19.561660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:19.561948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:19.562229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:19.585352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:19.586559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:19.599235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 127/259] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:52:20.002812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf166-71ec-4eca-a4c6-51ae282dc70c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.017201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf166-71ec-4eca-a4c6-51ae282dc70c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.022851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.023485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.023763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.024036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.036814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:20.041852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:20.042718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:20.043500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 133/260] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:20.049563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.058376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.061773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93287f8-40f3-4e68-89d7-0af3e1386c18 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.070423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.071312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.071790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.072256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.072667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92e3c-79c8-45b4-a264-229c9993b866 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.073519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:20.074090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.076108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:52:20.076108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 10:52:20.076108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 10:52:20.077406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.079117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.080093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.084357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.084357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.092173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 128/261] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:20.104825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:20.106730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:20.111018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:20.111896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:20.112727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 134/262] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:20.120948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.124456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155a979-05f3-40f0-9b2e-42e05988b7ce admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.135083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27aa03-b84a-4943-a7a9-ecad3c890b2c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.135255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.135734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.136018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.136289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.139827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.140519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.140893 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.141168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.141839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:20.142378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.144321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:52:20.144321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 10:52:20.144321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 10:52:20.145576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.151446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.153109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:52:20.153109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 10:52:20.153109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 10:52:20.154383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.159141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 129/263] 10.222.0.49 () {56 vars in 1201 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:20.160783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 135/264] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:20.163944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.165931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.183269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061262-a081-4817-ba69-4b9f7301914c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.186397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e6c1-8b05-4b63-8079-ca497b5bcfe1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.193205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.195431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.195943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.196685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.197203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.198262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.199485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.199943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.200413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.202237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:52:20.202237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 10:52:20.202237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 10:52:20.203892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.207299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.207651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.211140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 136/265] 10.222.0.49 () {56 vars in 1201 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:20.211672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 130/266] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:20.216696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.225666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.240698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24898ad-957d-4172-9fca-9855e2f60f0c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.241469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612f24-8133-4b96-b449-5a505ce3efff admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.253140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.253730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.254008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.254286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.254389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.255421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.255900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.256405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.258826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20173cdcf21141bd904e931cb78caa92, group_id=59ce7d3dddcd46ad8e31862cf201e312, role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.260145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:52:20.260145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 10:52:20.260145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 10:52:20.261019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.262835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363e09c-16ef-401a-a35f-20eb257bf2bd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.263107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.265569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 137/267] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Oct 26 10:52:20 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:20.272564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:20.283140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcf39f-7dc4-4503-9cb5-bf1c796b023c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:20.291656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 131/268] 10.222.0.49 () {58 vars in 1463 bytes} [Wed Oct 26 10:52:20 2022] PUT /identity/v3/projects/20173cdcf21141bd904e931cb78caa92/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:52:20.299561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:20.300294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.300596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.300921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.303148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20173cdcf21141bd904e931cb78caa92, group_id=59ce7d3dddcd46ad8e31862cf201e312, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:20.304221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:52:20.304221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 10:52:20.304221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 10:52:20.306331 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d0cc0-0b78-4f68-bafc-a6b6a87beed2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:20.334896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 138/269] 10.222.0.49 () {58 vars in 1463 bytes} [Wed Oct 26 10:52:20 2022] PUT /identity/v3/projects/20173cdcf21141bd904e931cb78caa92/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:20.636857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2fffb-053d-4f7f-9418-884e225c3c4c None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.637394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2fffb-053d-4f7f-9418-884e225c3c4c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.637394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2fffb-053d-4f7f-9418-884e225c3c4c None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.638804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 132/270] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:20.644717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b405d1-6db1-4db3-839d-1541dd70a1ca None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.645223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b405d1-6db1-4db3-839d-1541dd70a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.645223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b405d1-6db1-4db3-839d-1541dd70a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.676991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-11b405d1-6db1-4db3-839d-1541dd70a1ca None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:20.678234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-11b405d1-6db1-4db3-839d-1541dd70a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:20.748031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:20.775208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 139/271] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 26 10:52:20.836499 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae407d-07cc-4eae-8f51-b9d6864d4be8 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.836820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae407d-07cc-4eae-8f51-b9d6864d4be8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.837053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae407d-07cc-4eae-8f51-b9d6864d4be8 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.838567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 133/272] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:20.844507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3f75-0546-4bb8-99e6-f5a2ac91edfb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:20.844797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3f75-0546-4bb8-99e6-f5a2ac91edfb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:20.845068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3f75-0546-4bb8-99e6-f5a2ac91edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:20.869340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-28de3f75-0546-4bb8-99e6-f5a2ac91edfb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:20.870583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-28de3f75-0546-4bb8-99e6-f5a2ac91edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:20.954434 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 140/273] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:21.114477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53c5a-22d9-441b-b3fe-6634bb9cec53 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.114786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53c5a-22d9-441b-b3fe-6634bb9cec53 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.115032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53c5a-22d9-441b-b3fe-6634bb9cec53 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.116562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 134/274] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:21.122052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.122565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.123886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.129224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53c5a-22d9-441b-b3fe-6634bb9cec53 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.146059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53c5a-22d9-441b-b3fe-6634bb9cec53 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.157633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.158556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.159058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.159547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.171375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:21.174409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:21.183723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:21.189398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:21.190262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:21.191065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:21.196312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 141/275] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 26 10:52:21.197694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 135/276] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:21.203568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.213534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4062a9-a09c-48e4-b06f-5d3c056ab4f6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.218874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.219733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.220223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.220713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.221597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:21.222097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.224059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.235586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 142/277] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:21.240747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.251333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a28d-91f7-4c97-aa7e-263d99b51a15 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.260006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.260939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.261473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.261946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.263303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.265578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.267422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 136/278] 10.222.0.49 () {56 vars in 1201 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:21.273064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.284456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e436e4c-5987-4861-97e0-6194d8f2f137 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.291135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.292018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.292530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.293006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.294459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.297409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.299591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 143/279] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:21.304884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.316747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec0ab6-6436-4c55-b15b-1f2e865eb955 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.324062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.325049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.325585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.326687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.329037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b540a171f6e488ba1ae0c6074f6427f, group_id=59ce7d3dddcd46ad8e31862cf201e312, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.332079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.346812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 137/280] 10.222.0.49 () {58 vars in 1463 bytes} [Wed Oct 26 10:52:21 2022] PUT /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:52:21.386606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.509363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:21.514685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f597e-27cd-4dee-92e1-8badca1ef8c7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.558134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.559149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.559748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.560224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.572690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:21.579160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:21.580070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 26 10:52:21.581231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:21.585645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 144/281] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:21.589983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.600740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:21.639980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.735222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60459-857f-4264-bbd8-426b700738b4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.740432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.741257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.741593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.741863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.759625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:21.766375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:21.767288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:21.768140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 145/282] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:21.776373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.785781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5d6db-339e-4368-b018-40a73b71fbc5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.797939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641582f6-c32b-430d-80fe-b1a989ed1b8b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.808113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.808754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.809030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.809399 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.810159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:21.810526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.815537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.831312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 146/283] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:21.836539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.853462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.854108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.854389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.854661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.855327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:21.856154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e777c-b169-4c79-991d-8a2d7619fc6c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.857481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.860474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.865099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.865781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.866057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.867116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.869427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.872362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.876529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 147/284] 10.222.0.49 () {56 vars in 1201 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:21.880060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 138/285] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:21.881710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.893267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.908009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ccabd-df06-42e9-bc2a-476892c6aedc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.921181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.921844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.922127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.922401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.923699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.925843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:21.927950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 148/286] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:21.940791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:21.956377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ef016-fe71-41bb-b7a6-193f21830f07 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:21.981048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:21.981730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:21.982010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:21.982315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:21.993141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b540a171f6e488ba1ae0c6074f6427f, group_id=59ce7d3dddcd46ad8e31862cf201e312, role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:21.995817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.002488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:22.031061 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 149/287] 10.222.0.49 () {58 vars in 1463 bytes} [Wed Oct 26 10:52:21 2022] PUT /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f/groups/59ce7d3dddcd46ad8e31862cf201e312/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:52:22.053622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9b93-a4bf-4f27-93aa-9e97a323c87a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.111612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b27c6-01fd-4ae4-bf66-2e0bfe8f1873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.112278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b27c6-01fd-4ae4-bf66-2e0bfe8f1873 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.112587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b27c6-01fd-4ae4-bf66-2e0bfe8f1873 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.112866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b27c6-01fd-4ae4-bf66-2e0bfe8f1873 None admin] PATH_INFO: `/v3/users/ee55dfdf30b24adc84be293d06c56720` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.117087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b27c6-01fd-4ae4-bf66-2e0bfe8f1873 None admin] RBAC: Authorizing `identity:get_user(user_id=ee55dfdf30b24adc84be293d06c56720)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:22.118606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b27c6-01fd-4ae4-bf66-2e0bfe8f1873 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.120398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 139/288] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:52:21 2022] GET /identity/v3/users/ee55dfdf30b24adc84be293d06c56720 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:22.127306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:22.234204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:22.273453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6df9e-894e-4e1f-8736-ff002409bf1e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.319085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d989d-5493-499d-a12a-1fe40e569f37 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.319293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d989d-5493-499d-a12a-1fe40e569f37 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.319572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d989d-5493-499d-a12a-1fe40e569f37 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.320196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.320848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.321129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.321400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.322142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] RBAC: Adding query filter params (role.id=9db0e33d47cc40eda3a47f7297ce6273, user.id=ee55dfdf30b24adc84be293d06c56720, scope.system=all) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:22.322508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:22.322905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 140/289] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:22.324002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.328304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.328891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.329922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.345980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 150/290] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Oct 26 10:52:22 2022] GET /identity/v3/role_assignments?user.id=ee55dfdf30b24adc84be293d06c56720&scope.system=all&role.id=9db0e33d47cc40eda3a47f7297ce6273 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:22.366548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:22.368141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:22.452450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 141/291] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 26 10:52:22.747686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:22.759800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f982-f661-4c56-9857-f83c9084c303 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.764597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.765450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.765931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.766402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.778330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:22.784083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:22.784987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:22.785771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:22.788286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 151/292] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:22.794435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:22.806480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f738-5f1a-463f-9265-667c7119cac0 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.811387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.812241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.812670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.813098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.814031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:22.814495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:22.816245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.826135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 142/293] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:22.831877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:22.842739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c0611-204d-4138-8ff0-42f039b085f4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.847429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.848232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.848767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.849186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] PATH_INFO: `/v3/groups/c58d3ade702f498897054f536d64c328` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.856126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] RBAC: Authorizing `identity:get_group(group_id=c58d3ade702f498897054f536d64c328)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:22.859193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.861087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 152/294] 10.222.0.49 () {56 vars in 1201 bytes} [Wed Oct 26 10:52:22 2022] GET /identity/v3/groups/c58d3ade702f498897054f536d64c328 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:22.866758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:22.877286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578567a-2c2c-47a7-940e-a2a28c9b06e4 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.881899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032d52-5bf0-4a5c-83f3-b264ee4c55fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.882724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032d52-5bf0-4a5c-83f3-b264ee4c55fd admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.883147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032d52-5bf0-4a5c-83f3-b264ee4c55fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.883561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032d52-5bf0-4a5c-83f3-b264ee4c55fd admin admin] PATH_INFO: `/v3/projects/984efe81cc5c444a9df8508547d09873` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.884858 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032d52-5bf0-4a5c-83f3-b264ee4c55fd admin admin] RBAC: Authorizing `identity:get_project(project_id=984efe81cc5c444a9df8508547d09873)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:22.886807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032d52-5bf0-4a5c-83f3-b264ee4c55fd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.888655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 143/295] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Oct 26 10:52:22 2022] GET /identity/v3/projects/984efe81cc5c444a9df8508547d09873 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:22.894697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:22.906442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928685f-9ff8-468d-9e55-0e6c2dc6c25f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:22.911282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408fd6-aba7-46c5-ab11-8cb1b4342d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:22.912178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408fd6-aba7-46c5-ab11-8cb1b4342d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:22.912628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408fd6-aba7-46c5-ab11-8cb1b4342d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:22.913095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408fd6-aba7-46c5-ab11-8cb1b4342d98 admin admin] PATH_INFO: `/v3/projects/984efe81cc5c444a9df8508547d09873/groups/c58d3ade702f498897054f536d64c328/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:22.915238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408fd6-aba7-46c5-ab11-8cb1b4342d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984efe81cc5c444a9df8508547d09873, group_id=c58d3ade702f498897054f536d64c328, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:22.918181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408fd6-aba7-46c5-ab11-8cb1b4342d98 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:22.944133 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 153/296] 10.222.0.49 () {58 vars in 1463 bytes} [Wed Oct 26 10:52:22 2022] PUT /identity/v3/projects/984efe81cc5c444a9df8508547d09873/groups/c58d3ade702f498897054f536d64c328/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:23.395731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afceb9-ec5a-4429-a6ca-44c6d892436c None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:23.396237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afceb9-ec5a-4429-a6ca-44c6d892436c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:23.396685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afceb9-ec5a-4429-a6ca-44c6d892436c None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:23.398260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 144/297] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:23.403780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df104-7586-493f-a96a-9c5a429e745f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:23.404610 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df104-7586-493f-a96a-9c5a429e745f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:23.404890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df104-7586-493f-a96a-9c5a429e745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:23.433755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-653df104-7586-493f-a96a-9c5a429e745f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:23.434949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-653df104-7586-493f-a96a-9c5a429e745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:23.521937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 154/298] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:23.897304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf8673-81b5-465e-873f-7f3b9097e0d8 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:23.898306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf8673-81b5-465e-873f-7f3b9097e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:23.898789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf8673-81b5-465e-873f-7f3b9097e0d8 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:23.900321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 145/299] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:23.906157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:23.906567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:23.906753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:23.933269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:23.934449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:23.958684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:23.982074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf8673-81b5-465e-873f-7f3b9097e0d8 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:24.015482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 155/300] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:24.121179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:24.195445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf8673-81b5-465e-873f-7f3b9097e0d8 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:24.261083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:24.261743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.262021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.262293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.285664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:24.291034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:24.291914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:24.292791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 146/301] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:52:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:24.301443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:24.428132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:24.462841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a9d7-e5cc-4059-a7ee-394ce2240cb5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:24.529264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:24.531424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.532136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.533606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.534499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:24.535181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:24.537389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:24.559677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 156/302] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:24.571121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:24.608371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:24.611302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7a461-ad98-45c2-a37e-dafb54570290 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:24.653492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:24.668084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:24.668752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.669020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.669295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.693327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:24.698482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:24.699386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:24.700161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 147/303] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:24.709214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:24.719439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f24cc-f494-414b-918b-bd1742a58900 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:24.765979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:24.766649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.766932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.767201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.843338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0c7f0-f86c-44e7-addc-4fc123da0c03 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:24.849779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:24.851238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:24.876220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:24.901075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:24.901691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.901973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.902245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.902910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] RBAC: Adding query filter params (name=member) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:24.903211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:24.905341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819525b-6235-446a-9483-4a0fb248589a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:24.917233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 148/304] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:24.920234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f641-2c5b-48e6-8406-61aefb8ec557 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.920234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f641-2c5b-48e6-8406-61aefb8ec557 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.920234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f641-2c5b-48e6-8406-61aefb8ec557 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.920234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 149/305] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:24.925984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:24.926283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:24.926551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:24.949091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:24.950588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:24.980079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 157/306] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:24.981668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.002776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.033938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 150/307] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:25.040404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.101250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7fa20-4b0a-40e0-b6f0-3a0e890dab58 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.121040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.142466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83df42-ce93-4d39-8f3a-8e853ac4d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.143086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83df42-ce93-4d39-8f3a-8e853ac4d462 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.143370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83df42-ce93-4d39-8f3a-8e853ac4d462 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.143646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83df42-ce93-4d39-8f3a-8e853ac4d462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.222809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83df42-ce93-4d39-8f3a-8e853ac4d462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.224328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83df42-ce93-4d39-8f3a-8e853ac4d462 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:25.270040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e4ef-c3a0-4899-9edb-d9612a5f13ff None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.339166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830e523-fbf9-4d91-b67f-500e2a05ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.339818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830e523-fbf9-4d91-b67f-500e2a05ae52 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.340098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830e523-fbf9-4d91-b67f-500e2a05ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.340397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830e523-fbf9-4d91-b67f-500e2a05ae52 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.341846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830e523-fbf9-4d91-b67f-500e2a05ae52 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.344057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830e523-fbf9-4d91-b67f-500e2a05ae52 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:25.346031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 151/308] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:25.347667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98f887-4958-4100-a45f-65250f313af8 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.347955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98f887-4958-4100-a45f-65250f313af8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.348227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98f887-4958-4100-a45f-65250f313af8 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.349929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 152/309] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:25.353168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98f887-4958-4100-a45f-65250f313af8 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.355308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 158/310] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:25.361735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.362007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.362279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.381862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:25.383283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:25.400526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.405975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.462398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98f887-4958-4100-a45f-65250f313af8 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.467014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 159/311] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:25.468081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.499738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.500427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.501004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.501131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.502175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.503624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:25.505509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 153/312] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:25.506556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.574156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae587a-aee3-4f53-b28e-973e1dd408ad None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.610562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.611560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.612037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.613620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] PATH_INFO: `/v3/projects/20173cdcf21141bd904e931cb78caa92` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.613837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8cb33-17f4-42da-bc8c-6563b9afa7b6 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.615230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] RBAC: Authorizing `identity:get_project(project_id=20173cdcf21141bd904e931cb78caa92)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.616915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:25.618788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 160/313] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/projects/20173cdcf21141bd904e931cb78caa92 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:25.619754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.632367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.639384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.656703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.657490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.657771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.658072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.670492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:25.675888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:25.677200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 154/314] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:25.677984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.738395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8231e-5a65-4f4f-a9a4-b22a0b2077e2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.779643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.780620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.781119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.781586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.782499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] RBAC: Adding query filter params (group.id=59ce7d3dddcd46ad8e31862cf201e312, role.id=c4333dc639d7498fbb17ff5eaeac2457, scope.project.id=20173cdcf21141bd904e931cb78caa92) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:25.783000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.784704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:25.791834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 161/315] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/role_assignments?group.id=59ce7d3dddcd46ad8e31862cf201e312&scope.project.id=20173cdcf21141bd904e931cb78caa92&role.id=c4333dc639d7498fbb17ff5eaeac2457 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:25.792926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.807017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d6fc6-6b0d-4e0b-bd6c-f648b1c935a6 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.845485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.846067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.846346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.846620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.848869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.850342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:25.851976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 155/316] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:25.852845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:25.894962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.902850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:25.930162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c3c1-8487-4528-94a4-d088c0b3e338 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.981951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:25.984987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:25.985466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:25.985882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:25.986710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:25.987154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:25.987291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c153a-7e30-46be-972e-27e557d9cea5 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:25.988997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.001523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 162/317] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:26.002666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.031926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.032695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.033071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.033417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.048583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:26.053757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:26.054623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:26.055388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:26.057618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 156/318] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:26.058613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.142512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249570f-1a78-4375-bfcc-897b97039326 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.180862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.181807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.182080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.182348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.183071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] RBAC: Adding query filter params (group.id=59ce7d3dddcd46ad8e31862cf201e312, role.id=3b1990b4aec64813be7704740acbd303, scope.project.id=20173cdcf21141bd904e931cb78caa92) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:26.183373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.184823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.192611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 163/319] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/role_assignments?group.id=59ce7d3dddcd46ad8e31862cf201e312&scope.project.id=20173cdcf21141bd904e931cb78caa92&role.id=3b1990b4aec64813be7704740acbd303 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:26.193106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55096d-8d0d-4c49-8688-83e19917e5b4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.193900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.194756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:26.206869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:26.234992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6102-fece-4147-9a16-a0872e4e38eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.235625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6102-fece-4147-9a16-a0872e4e38eb None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.235902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6102-fece-4147-9a16-a0872e4e38eb None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.236182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6102-fece-4147-9a16-a0872e4e38eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.327788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6102-fece-4147-9a16-a0872e4e38eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.329554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6102-fece-4147-9a16-a0872e4e38eb None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.337910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad42c47-c954-47d4-a34b-0a80ab5625d5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.389254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.389799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.390080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.390348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.391016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:26.391317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.392739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1257bd-d0c7-47e1-8d17-bf87c44cd261 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.403269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 164/320] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:26.406171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f0f8-7081-49ba-ac09-8b73938039db None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.406466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f0f8-7081-49ba-ac09-8b73938039db None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.406743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f0f8-7081-49ba-ac09-8b73938039db None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.407992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 165/321] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:26.412545 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f0f8-7081-49ba-ac09-8b73938039db None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.461214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 157/322] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:26.461214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.461214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.461214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.468971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:26.482897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:26.484410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:26.500868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:26.539931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f0f8-7081-49ba-ac09-8b73938039db None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.562186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 158/323] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:26.563039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.575309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.575984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.576281 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.576573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.668925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.671113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.694599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c751-81fc-4e90-a44f-e38b0a806656 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.734854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:26.740918 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.741759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.742234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.742508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.743608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.745068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.746682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 159/324] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:26.752633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.757092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:26.811411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 166/325] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:26.817299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.874231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8f2ef-2eab-4fa9-90a0-671d0f0983d2 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.912374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.912374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.912374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.912374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.913307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.914740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.916583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 160/326] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:26.917101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.934603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55b8a-b592-4567-8017-88fb4ca01fe0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:26.978026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:26.978817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:26.979219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:26.979860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] PATH_INFO: `/v3/projects/6b540a171f6e488ba1ae0c6074f6427f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:26.980723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] RBAC: Authorizing `identity:get_project(project_id=6b540a171f6e488ba1ae0c6074f6427f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:26.982711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:26.985377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 167/327] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/projects/6b540a171f6e488ba1ae0c6074f6427f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:26.989870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:26.995753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.031280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.040660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47231-16bd-4e80-898a-7454a34332f7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.080570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.081200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.081476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.081744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.100085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:27.104577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:27.105459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:27.106249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 161/328] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:27.106888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:27.111441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd1360-1f65-4090-bfd9-a2d4ea878665 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.152090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.152726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.153004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.153274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.153992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] RBAC: Adding query filter params (group.id=59ce7d3dddcd46ad8e31862cf201e312, role.id=3b1990b4aec64813be7704740acbd303, scope.project.id=6b540a171f6e488ba1ae0c6074f6427f) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:27.154827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:27.156247 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:27.162245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 168/329] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Oct 26 10:52:26 2022] GET /identity/v3/role_assignments?group.id=59ce7d3dddcd46ad8e31862cf201e312&scope.project.id=6b540a171f6e488ba1ae0c6074f6427f&role.id=3b1990b4aec64813be7704740acbd303 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:27.162887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:27.240127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b904-fc9c-4fbf-854b-a44518600789 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.276887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.287955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.289192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.289476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.289928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] PATH_INFO: `/v3/groups/59ce7d3dddcd46ad8e31862cf201e312` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.291120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] RBAC: Authorizing `identity:get_group(group_id=59ce7d3dddcd46ad8e31862cf201e312)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:27.292627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:27.294267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 162/330] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Oct 26 10:52:27 2022] GET /identity/v3/groups/59ce7d3dddcd46ad8e31862cf201e312 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:27.300448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:27.311890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.317529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6cbd-3ec4-4b10-95f6-aa83e280af73 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.356210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.356849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.357334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.357613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.358922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:27.359335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:27.360610 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:27.371494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 169/331] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:27.377533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:27.424697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742ab2-71c7-4bea-bbfd-eee7e5bf971a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.461640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.462249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.462529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.462803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.463523 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] RBAC: Adding query filter params (group.id=59ce7d3dddcd46ad8e31862cf201e312, role.id=c4333dc639d7498fbb17ff5eaeac2457, scope.project.id=6b540a171f6e488ba1ae0c6074f6427f) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:27.463830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:27.465301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:27.472144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 163/332] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Oct 26 10:52:27 2022] GET /identity/v3/role_assignments?group.id=59ce7d3dddcd46ad8e31862cf201e312&scope.project.id=6b540a171f6e488ba1ae0c6074f6427f&role.id=c4333dc639d7498fbb17ff5eaeac2457 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:27.506637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08c2b2-7ff6-4739-823e-355e8ca3c350 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.549046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.549683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.549961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.550231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.587699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.628175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:27.629731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:27.728540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 170/333] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:27.735055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:27.796075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.837006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531ab9-cfa7-44b4-9c23-366eebfd31d6 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:27.870441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:27.871066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:27.871343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:27.871613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] PATH_INFO: `/v3/projects/984efe81cc5c444a9df8508547d09873` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:27.873241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=984efe81cc5c444a9df8508547d09873)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:27.874678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:27.876289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 164/334] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:52:27 2022] GET /identity/v3/projects/984efe81cc5c444a9df8508547d09873 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:27.881818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:27.939831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:27.977074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26dfad-19df-47f3-a20c-cb1f4eaa5582 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:28.009354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c43c7-1a1a-4082-acb7-30890b95fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:28.009967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c43c7-1a1a-4082-acb7-30890b95fc47 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:28.010245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c43c7-1a1a-4082-acb7-30890b95fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:28.010519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c43c7-1a1a-4082-acb7-30890b95fc47 None admin] PATH_INFO: `/v3/groups/c58d3ade702f498897054f536d64c328` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:28.011592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c43c7-1a1a-4082-acb7-30890b95fc47 None admin] RBAC: Authorizing `identity:get_group(group_id=c58d3ade702f498897054f536d64c328)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:28.015325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c43c7-1a1a-4082-acb7-30890b95fc47 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:28.016886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 171/335] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Oct 26 10:52:27 2022] GET /identity/v3/groups/c58d3ade702f498897054f536d64c328 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:28.022612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:28.118452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68621a40-388b-474b-a7a6-0e09daf1bbf1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:28.144051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:28.152082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:28.152721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:28.153000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:28.153271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:28.153997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] RBAC: Adding query filter params (group.id=c58d3ade702f498897054f536d64c328, role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=984efe81cc5c444a9df8508547d09873) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:28.154307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:28.155728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23785d5-43f8-4379-ab92-0ec448c175b0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:28.161491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 165/336] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Oct 26 10:52:28 2022] GET /identity/v3/role_assignments?group.id=c58d3ade702f498897054f536d64c328&scope.project.id=984efe81cc5c444a9df8508547d09873&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:30.722395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67dc64-62e1-4792-8056-9401b3c525f5 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:30.723446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67dc64-62e1-4792-8056-9401b3c525f5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:30.723933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67dc64-62e1-4792-8056-9401b3c525f5 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:30.725626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 172/337] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:30.730832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a626cc6-bc7d-4746-8b93-bdb361ab05fe None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:30.731669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a626cc6-bc7d-4746-8b93-bdb361ab05fe None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:30.732740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a626cc6-bc7d-4746-8b93-bdb361ab05fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:30.759119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7a626cc6-bc7d-4746-8b93-bdb361ab05fe None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:30.760703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7a626cc6-bc7d-4746-8b93-bdb361ab05fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:30.848802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 166/338] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:31.136935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d8cf-3715-4115-9564-5264a7be3730 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.136935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d8cf-3715-4115-9564-5264a7be3730 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.136935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d8cf-3715-4115-9564-5264a7be3730 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.136935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 173/339] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:31.143095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf80c5-8cf5-4fc8-bcac-3d86866f1044 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.143622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf80c5-8cf5-4fc8-bcac-3d86866f1044 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.144107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf80c5-8cf5-4fc8-bcac-3d86866f1044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.173147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-feaf80c5-8cf5-4fc8-bcac-3d86866f1044 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:31.174703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-feaf80c5-8cf5-4fc8-bcac-3d86866f1044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:31.241522 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8d8cf-3715-4115-9564-5264a7be3730 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:31.272826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 167/340] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:31.387489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb57d6-36f4-4e8d-ab12-446f5d2e2b04 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.388095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb57d6-36f4-4e8d-ab12-446f5d2e2b04 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.388612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb57d6-36f4-4e8d-ab12-446f5d2e2b04 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.390579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 168/341] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:52:31.395082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.395374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.395654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.409937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8d8cf-3715-4115-9564-5264a7be3730 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:31.430158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:31.431670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:31.445783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:31.461781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:31.462747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.463283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.463745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.483462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:31.486595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:31.521469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:31.522512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:31.523385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:31.523385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:31.523385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:31.525537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 174/342] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:31.527210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:31.544441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:31.571736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 169/343] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:31.618920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:31.708707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f501-43aa-46fd-9272-851ac91e8d29 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:31.746321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:31.747704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.748312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.748829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.749746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:31.750246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:31.752186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b194e1-5944-46aa-9a36-c7b0702091cc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:31.758660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af7f2-0f64-4f01-abb2-8483e6e6163f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:31.769938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 175/344] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:31.771598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d752f-2b99-43f3-b7fe-7ab8bd8c8355 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.772082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d752f-2b99-43f3-b7fe-7ab8bd8c8355 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.772564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d752f-2b99-43f3-b7fe-7ab8bd8c8355 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.774207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 176/345] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:31.779876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d752f-2b99-43f3-b7fe-7ab8bd8c8355 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:31.799580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:31.800234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.800528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.801044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.814071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:31.816191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:31.830633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-eb07ee8e-6d12-4d46-bd0a-9687975d2332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:31.835631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:31.836557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:31.838074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:31.838074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:31.838074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:31.838074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 170/346] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:31.838569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.838728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.838980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.863351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:31.864586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:31.896885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:31.902868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d752f-2b99-43f3-b7fe-7ab8bd8c8355 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:31.938001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:31.938625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:31.938941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:31.939169 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:31.939863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:31.951248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 171/347] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:31.951475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:31.951570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:31.975982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 177/348] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:31 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:31.976876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.057437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5264c-d9d0-46e1-aeb5-3db2935e3f90 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.099074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:32.103800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768e33-4101-4119-bb58-b69bb655cff2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.110432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.111063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.111340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.111609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.112273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:32.112606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.114584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856dc91-38da-43e2-9eb3-5831824d8abc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.128946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 172/349] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:32.130347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51775dc-a270-4833-98ae-005ac4690ee4 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.130733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51775dc-a270-4833-98ae-005ac4690ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.131009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51775dc-a270-4833-98ae-005ac4690ee4 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.132322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 173/350] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:32.137437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51775dc-a270-4833-98ae-005ac4690ee4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.143617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.144275 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.144713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.144993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.158237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.159867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.169146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-eb3f99d0-2112-4214-9259-c87a6f102250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:32.178769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:32.179773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:32.180657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:32.180657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:32.180657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:32.180657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 178/351] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:32.181283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.181424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.181989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.203059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:32.204415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:32.266073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51775dc-a270-4833-98ae-005ac4690ee4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.281483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 179/352] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:32.289307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.308100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.308750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.309030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.309300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.309941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.312110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.338643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 174/353] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:32 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:32.340362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.405476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:32.433647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b50fa-b673-433f-8e27-3a9e27231c7c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.500749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.501752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.502239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.502760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.503616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:32.504533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.507865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.512598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:32.531362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 180/354] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:32.539503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.546148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6e0d-bdf1-4fff-8f16-09b87e02db99 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.587400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.588437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.588931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.589437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.604895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.606862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:32.625926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:32.626890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:32.627737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:32.627737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:32.627737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.629594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 175/355] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:32.630705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.660220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b4797-ee6d-436d-8b08-a7d0a123a69a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.695311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.695684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.695964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.696237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.696915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.698351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.710060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:32.725759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 181/356] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:32 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:52:32.726700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.747373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13a609-1d42-4108-9f06-2dfadb18a41f None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.780952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:32.786186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.786862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.787246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.787614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.788469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.790241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.800021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.sql.core [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 26 10:52:32.800021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 26 10:52:32.800021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [parameters: {'id': '393b9a9a158142be9903f125a5924979', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 26 10:52:32.800021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:52:32.808267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return ref.to_dict() Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:52:32.809306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application yield resource Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise self.value Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application session.commit() Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:52:32.810815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:52:32.811667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:52:32.812786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:52:32.813777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [parameters: {'id': '393b9a9a158142be9903f125a5924979', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:32.814806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 26 10:52:32.815783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.816911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 176/357] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Oct 26 10:52:32 2022] POST /identity/v3/roles => generated 144 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:32.818356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.868965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d572-f70e-4cbf-af69-38a35b33f953 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.933375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8e076-756e-4cd5-81a1-ecc74e139d24 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:32.937796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.938620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.939064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.939490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.940287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:32.940828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:32.942356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:32.968925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 182/358] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:32.972592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:32.973435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:32.973812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:32.974204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:32.974605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:32.986978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:32.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:32.994469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:32.995298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 177/359] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:33.001988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:33.079246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:33.086788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:33.115927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5afadc-3b1c-4b35-bdaf-6363be48efc1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:33.151766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b021e-ee19-4886-b3eb-c3705fb6ba9c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:33.154947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:33.155557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:33.155833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:33.156104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:33.156812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:33.157114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:33.158485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9764c10-b079-4186-99bf-fb5be3fa1fd1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:33.172753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 178/360] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:33.190952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278243f4-aa52-4db5-8af5-cc37576b488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:33.191631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278243f4-aa52-4db5-8af5-cc37576b488d None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:33.191905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278243f4-aa52-4db5-8af5-cc37576b488d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:33.192227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278243f4-aa52-4db5-8af5-cc37576b488d None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:33.192939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278243f4-aa52-4db5-8af5-cc37576b488d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:33.194428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278243f4-aa52-4db5-8af5-cc37576b488d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:33.223466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 183/361] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:32 2022] POST /identity/v3/users => generated 249 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:34.520878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c4aae-a7b2-44a7-afa6-7d7a47a3ffcb None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:34.521371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c4aae-a7b2-44a7-afa6-7d7a47a3ffcb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:34.521371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c4aae-a7b2-44a7-afa6-7d7a47a3ffcb None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:34.522922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 179/362] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:34.536754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8021fd-bb71-4376-bf4c-d684446871a4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:34.537294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8021fd-bb71-4376-bf4c-d684446871a4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:34.537294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8021fd-bb71-4376-bf4c-d684446871a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:34.561276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3c8021fd-bb71-4376-bf4c-d684446871a4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:34.562486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3c8021fd-bb71-4376-bf4c-d684446871a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:34.635594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 184/363] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:34.911605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c4aae-a7b2-44a7-afa6-7d7a47a3ffcb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:34.957896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f11a-63a7-4368-b649-5965d8215b2a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:34.958376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f11a-63a7-4368-b649-5965d8215b2a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:34.958855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874f11a-63a7-4368-b649-5965d8215b2a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:34.964982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 185/364] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:52:34.973869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:34.974147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:34.974417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.007545 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:35.009598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:35.064712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:35.100611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 186/365] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:35.121940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c4aae-a7b2-44a7-afa6-7d7a47a3ffcb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:35.152242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:35.179354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:35.179917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.180188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.180484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.195255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:35.200599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:35.201580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:35.202367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 180/366] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:35.208988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:35.355018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad27185-c92d-4eea-97f8-9cd9f6819fc7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:35.400411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:35.401023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.401299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.401568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.402222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:35.402520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:35.404388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:35.415263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 187/367] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:35.421398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:35.444954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:35.504437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:35.592725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18510a-3c8e-43c9-b04c-e7b0389cee99 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:35.621188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899daa-a376-4890-aac3-4b841b70a596 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:35.646964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:35.648156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.650220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.650773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.674751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:35.680821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:35.681782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:35.682592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:35.688369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 188/368] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:35.694451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:35.709681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:35.710251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.710524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.710793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.735331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:35.736805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:35.764944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:35.765933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:35.766768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:35.766768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:35.766768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:35.766768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 181/369] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:35.773817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:35.810413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:35.828121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:35.835153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ca3f-b774-419a-851d-ab23d9b6f2d9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:35.871544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:35.872569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.873077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.873544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.874401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:35.874899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:35.876497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad4a8e-29fc-49df-a989-ddc9b350c2d6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:35.884991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 189/370] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:35.890168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4759-d9a8-4f3d-8169-91054c4c71ff None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:35.891585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03e54-5c91-4e57-98ff-c435542bb4ea None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.892068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03e54-5c91-4e57-98ff-c435542bb4ea None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.892678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03e54-5c91-4e57-98ff-c435542bb4ea None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.894387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 190/371] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:35.895285 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03e54-5c91-4e57-98ff-c435542bb4ea None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:35.929656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:35.930530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.930810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.931081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.931986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:35.932815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:35.934537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1c841-b89c-45ea-a52c-e71e97b5accb None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:35.950080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 182/372] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:35.951701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6093f-0c7a-4910-9bbd-c2e1efd68a0f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:35.951985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6093f-0c7a-4910-9bbd-c2e1efd68a0f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:35.952253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6093f-0c7a-4910-9bbd-c2e1efd68a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:35.973853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6bc6093f-0c7a-4910-9bbd-c2e1efd68a0f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:35.975788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6bc6093f-0c7a-4910-9bbd-c2e1efd68a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:36.012404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03e54-5c91-4e57-98ff-c435542bb4ea None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.050870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.051502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.051777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.052045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.052478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 183/373] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:36.053616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae2e2-eab1-4c64-a674-6bc26ac31e11 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.053902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae2e2-eab1-4c64-a674-6bc26ac31e11 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.054180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae2e2-eab1-4c64-a674-6bc26ac31e11 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.055494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 184/374] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:36.060094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae2e2-eab1-4c64-a674-6bc26ac31e11 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.075064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.077733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.083957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-62294b51-bd46-4801-817d-8a397d179392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:36.097455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:36.098383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:36.099227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:36.099227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:36.099227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:36.101265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 191/375] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:36.104021 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.104644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.105140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.129835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:36.131167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:36.133461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.184537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae2e2-eab1-4c64-a674-6bc26ac31e11 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.199799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 192/376] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:36.200715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.229999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.231385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.231920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.232743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.243096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.245749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-e395d45c-efb0-4f22-8784-472dc7c7abbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:36.263172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:36.264677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:36.265604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:36.268268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 185/377] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:36.270189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc2724-d836-4750-96a8-3be496fdcef5 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.270753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc2724-d836-4750-96a8-3be496fdcef5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.271293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc2724-d836-4750-96a8-3be496fdcef5 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.273437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 186/378] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:36.274320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc2724-d836-4750-96a8-3be496fdcef5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.321862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760d16-c8d9-4330-8945-0ecf677efd6b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.361535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.362140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.362417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.362677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.363305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:36.363601 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.365099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c208c-ec37-4dfb-968b-464a00e3594f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.366663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.372580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.378950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 193/379] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:36.380230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.380547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.380831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.392255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc2724-d836-4750-96a8-3be496fdcef5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.398622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:36.399784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:36.426238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.426831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.427350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.427350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.428067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:36.428383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.429802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.468102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 187/380] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:36.469301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.474179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 194/381] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:36.474887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.572373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b817fd-667a-48fa-ab7c-63d0c4428e83 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.584196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58495b4e-690c-4a32-a91c-e7d05464ddbf None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.607996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.609043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.609434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.609802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.612885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.616634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.621324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.621869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.622216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.622493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.623225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.624974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.630047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.631472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:36.641770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:36.642678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:36.643537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:36.643537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:36.643537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:36.644467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 188/382] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:36.645437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:36.645538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:36.646344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:52:36.647209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:36.651167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 195/383] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:36.651991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.756859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9998d4-ab5d-4013-802f-17a8194621e3 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.757315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05174e7-3a22-459a-9df1-11e11bbb447a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.790188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.790738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.790850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.791126 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.791356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.791454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.791631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.791952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.801611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.801724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:36.803046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:36.806840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:36.807724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:36.808552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 196/384] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:36.809250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:36.818808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:36.819716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:36.820608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:36.820608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:36.820608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:36.820608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 189/385] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:36.820817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.862931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.863533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:36.914215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1081f5-a83b-4852-90dd-ddf6874287a6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.922566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859ff9e-9618-490b-9c7c-13d1f21fb846 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:36.946970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.947573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.947850 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.948128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.948798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:36.949100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.950471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.956476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:36.957064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:36.957339 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:36.957607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:36.958329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:36.958627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:36.960036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:36.962860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 197/386] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:36.963652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:36.982985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 190/387] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:36.982985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.061105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c80d8-3f02-4c46-ab90-8bb48590c4ca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.070180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.079202 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.082477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ff5c-8fea-4c96-afbc-62ad35a3c104 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.097740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.098368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.098639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.098905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.109923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:37.114753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:37.115615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:37.116466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 198/388] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:37.117224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.123080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.123679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.123954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.124222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.124902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:37.125198 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.126540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.134527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 191/389] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:37.135262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.214397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee5e4f-9c65-4e00-8cef-4b61331ee27f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.236842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9605ce-cf2f-4cc8-869e-30637f599b2f None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.248408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.249009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.249283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.249551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.250186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:37.250481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.251959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.263762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 199/390] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:37.264579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.270156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.270758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.271038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.271310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.271943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.273395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.293677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.294154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 192/391] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:37 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:37.295018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.317533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.373650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07e722-fe53-4a26-91e7-b35a32a37321 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.411525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464e341-fd5d-46c4-840a-3681c90ef736 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.412563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.413317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.413592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.413965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.426126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.427711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:37.444006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:37.450612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:37.452019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:37.452019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:37.452019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:37.452019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 200/392] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:37.452019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.454507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.455137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.455419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.455696 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.456403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] RBAC: Adding query filter params (name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:37.456709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.458085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.468385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 193/393] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:37.468996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.543475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.557420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.565712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41609a54-b630-4e0d-a1e0-cf85d7155dec None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.577179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01778-6d12-48df-b4a3-e423262a06be None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.603981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.604646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.604919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.605189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.612839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.613472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.613753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.614029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.616282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.617742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.621191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.623128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:37.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:37.633840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:37.640388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:37.640388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:37.640388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:37.640388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 201/394] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:37.640657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:37.641812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:37.642674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:37.643074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.643141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 194/395] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:37.643141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.744065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437a799-5eb8-481d-ae94-e0c01a1bc02f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.746085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64892ed8-6f6a-44dc-a0d7-84de80281057 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.775103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.780924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.781573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.781855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.782123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.782810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:37.783053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.783435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.784067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.784365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.784471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.784642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.793567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:37.795640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.797427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.803539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 202/396] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:37.803539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:37.819917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:37.821110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:37.822217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:37.822217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:37.822217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:37.828634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 195/397] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:37.828634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.925020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357c81-a49a-41ac-aab7-ad39261fe93a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.936735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e9dd8-9633-48d0-ae3c-80e7ed542c52 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:37.961571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.962266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.962612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.962883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.963518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:37.963814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.965307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:37.979978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 203/398] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:37.979978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:37.981078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:37.982920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:37.984576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:37.984952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:37.985757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:37.986161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:37.987700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.012579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 196/399] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:38.012579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.043639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.071982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.099374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b266ee-ca2c-4a10-bf5f-dd655378df0d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.136351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.137059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.137422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.137666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.139953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd835341-9ceb-4d74-aba6-510e75bc0016 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.144890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.146338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:38.159121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:38.159993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:38.161455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 204/400] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:38.165789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.177067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.177608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.177887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.178158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.178804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:38.179103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.180532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.199902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 197/401] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:38.199902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.283030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2401f1-1b28-44b4-969e-1b7b39c9a7a0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.296059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.311093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fb43-35c0-4da2-9493-aaf9d8524481 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.317301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.318248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.318248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.318440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.326338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.326721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.328180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:38.339969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:38.340919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:38.342379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 205/402] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:38.342967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.357119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.357854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.358316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.358759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/ccb82753b2ec4f0b9386b42fd7f69cee/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.375787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=ccb82753b2ec4f0b9386b42fd7f69cee, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.377693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.391576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 198/403] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:38 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/ccb82753b2ec4f0b9386b42fd7f69cee/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:38.392688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.472386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956cc3d-87b1-404b-8325-6e800e6f1606 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.514652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1647-da8d-4d39-a94d-7bc870997321 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.515437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.516263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.516728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.517182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.518041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:38.518493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.520234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.547039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 206/404] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:38.547039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.564806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.565892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.566519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.567025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.576486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.578629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.584236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:38.595661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:38.596694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:52:38.597573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:38.599705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 199/405] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:38.600929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.628362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.673017 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6ea2a-ee87-4c66-b3cc-41ac28b84223 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.711794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.712432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.712751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.713397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.714863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:38.715240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.717644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.718644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38240f-441a-46a3-9bbc-810a9f25feb7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.755909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.756979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.757408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.757833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/dd246bbbfb444cd19f8e53157e2973e0/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.759827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 207/406] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:38.760776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.775828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=dd246bbbfb444cd19f8e53157e2973e0, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.777870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.796538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 200/407] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:38 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/dd246bbbfb444cd19f8e53157e2973e0/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:38.797817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:38.867973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.878633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2df13a-90f6-4202-81c9-45c77a1bea0b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:38.917074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:38.917909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:38.918187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:38.918457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:38.919259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:38.920106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:38.921843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:38.943742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:38.946303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 208/408] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:38.954015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.002600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522f28-3ae2-485f-81b7-4baf719d800b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.070308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.070854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.071132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.071404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.082617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.084059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:39.106451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:39.107999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:39.109120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:39.109120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:39.109120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:39.109120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 201/409] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:39.110528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.119138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afb913-992a-4866-a04f-df3cc875a546 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.165715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.166238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.166525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.166801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.182901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.182901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.194395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:39.216030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:39.217797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:39.218666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:39.218666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:39.218666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:39.220069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 209/410] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:39.227440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.279966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b90c6-59bb-40e3-b1bd-6fec8082a3b2 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.325833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:39.347100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.347760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.348045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.348318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.348986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:39.349287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.350675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.377954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 202/411] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:39.383598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.439006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40028-1722-4935-8c23-976abee02aa2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.486842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.487456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.487787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.488059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.488727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:39.489023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.490413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.504176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 210/412] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:39.513775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.591940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09bae5-68b8-4447-aea5-dddd80e42219 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.600566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:39.644511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f00ccd-5cc0-4164-aedc-02e972f7fd6b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.644697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.645207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.645466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.645737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.655380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.657304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-2a98c987-3697-4920-894f-d896bea6359f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:39.673679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:39.674749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:39.676131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 203/413] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:39.676645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0256-1fec-43bd-be0c-d0ab6eaccee4 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.676645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0256-1fec-43bd-be0c-d0ab6eaccee4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.676764 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa0256-1fec-43bd-be0c-d0ab6eaccee4 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.678227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 204/414] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:39.680472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa0256-1fec-43bd-be0c-d0ab6eaccee4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.685734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.686364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.686639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.686908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.693871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.695303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4f0d4d35-7fee-4e7d-9b9f-45a47c7dfa3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:39.707131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:39.707987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:39.709051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:39.712902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 211/415] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:39.714199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.714423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.714693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.738542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:39.739633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:39.741097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:39.816129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa0256-1fec-43bd-be0c-d0ab6eaccee4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:39.820736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 212/416] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:39.821823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.873503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:39.874023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:39.874293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:39.874559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:39.875244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:39.875965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:39.878268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:39.889602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:39.903127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 205/417] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:39.909453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:39.983658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8923-df8f-4f2c-87bb-f13e6fb99815 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:40.042649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:40.043251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:40.043520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:40.043784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:40.045101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:40.045401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:40.046830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:40.072255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 213/418] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:40.082516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:40.109476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff5c14-efc9-4786-b3a4-64c45b7f16bb None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:40.112043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:40.146607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:40.147189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:40.147466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:40.147730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/0a7700f8cf7049e18a9a530c00bb4d45/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:40.163130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=0a7700f8cf7049e18a9a530c00bb4d45, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:40.164895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:40.188366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 206/419] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:39 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/0a7700f8cf7049e18a9a530c00bb4d45/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:40.188366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:40.266258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb63abb-6e59-438b-8093-a48dee1bfa17 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:40.294210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:40.360518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:40.361199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:40.361479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:40.361753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/9e032cd87fb84d818b509c5af33716ff/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:40.381668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=9e032cd87fb84d818b509c5af33716ff, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:40.383109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:40.405623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 214/420] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:40 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/9e032cd87fb84d818b509c5af33716ff/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:40.411397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185676e-5804-4452-b68a-ac790b149806 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:40.460953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:40.461665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:40.461946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:40.462215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:40.475972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:40.481174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:40.482712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:40.484572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 207/421] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:40.489218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:40.622455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00a1b-e723-422b-9b97-0c793cdcd159 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:40.670267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:40.670791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:40.671065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:40.671330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:40.671982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:40.672279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:40.673719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:40.685052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 215/422] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:40.690416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:40.716953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:40.827032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf765-e3f5-402f-ab87-ec7e5e0ef194 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:40.863347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:40.864034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:40.864316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:40.864661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:40.875159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:40.876647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-4abbc7d6-7003-4aca-a0c3-e3910896a784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:40.891901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:40.892857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:40.893677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:40.893677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:40.893677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:40.893677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 208/423] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:40.898842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:40.931567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:41.028581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1439b7-f007-4b1d-9d40-9d0c10e2fb6f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:41.071942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165ad4-b9c2-4f50-b69d-3825081d9bd0 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.072215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165ad4-b9c2-4f50-b69d-3825081d9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.072571 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165ad4-b9c2-4f50-b69d-3825081d9bd0 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.074144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 209/424] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:41.079664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.079911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.080244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.081625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:41.082388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.082803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.083290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.084249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:41.084736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:41.086335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:41.107736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 216/425] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:41.112577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:41.113954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:41.118086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:41.178757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:41.187124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 210/426] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:41.255112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:41.286106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac4a77-10cb-4a46-b402-51dd2cc1ac0d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:41.339429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:41.340079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.340373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.340652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.348475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:41.349905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-38ac8cce-0883-4801-bc3e-5b2fe939374f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:41.369551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:41.370590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:41.371449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 217/427] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:41.381427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:41.457936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2b72-3074-49b0-a4dc-7a276db4aa56 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.458113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2b72-3074-49b0-a4dc-7a276db4aa56 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.458393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2b72-3074-49b0-a4dc-7a276db4aa56 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.459858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 218/428] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:41.465340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767465f-46ff-458e-9eac-c311d393753e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.465870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767465f-46ff-458e-9eac-c311d393753e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.466880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767465f-46ff-458e-9eac-c311d393753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.501222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d767465f-46ff-458e-9eac-c311d393753e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:41.502876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d767465f-46ff-458e-9eac-c311d393753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:41.525783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5b40-dc51-4732-a454-1c7fb484aa01 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:41.562149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:41.562761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.563036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.563312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.564439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:41.564752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:41.566447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:41.586802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 211/429] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Oct 26 10:52:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:41.592770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:41.650070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 219/430] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 26 10:52:41.667423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767465f-46ff-458e-9eac-c311d393753e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:41.672661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:41.719839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d686fa-5b35-4599-8628-c5d0551acfab None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:41.764357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:41.764357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.764357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.764357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:41.771646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:41.773440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:41.789589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:41.790473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:41.791312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:41.791312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:41.791312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:41.791312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 212/431] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:41.797354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:41.860674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:41.925719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767465f-46ff-458e-9eac-c311d393753e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:41.956010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738ee9-4da4-4aaa-ac92-d071b3f01953 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:41.971551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:41.990434 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:41.991079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:41.991357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:41.991623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.005145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:42.005508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.006343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.006836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.007300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.008123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:42.008661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:42.010095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:42.010989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 220/432] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:42.016802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.018147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.031593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 213/433] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:42.032817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.145987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994ed52-01ed-441f-b8dc-c3bf31b5d8fd None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.150408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b96af-e7b5-4999-aef2-ca12372ac666 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.187226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:42.189158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.190161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.190161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.190429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.191080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] RBAC: Adding query filter params (name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:42.191380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.192850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.196039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.196944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.197460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.198464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.205991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 214/434] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:42.205991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.217282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:42.223524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:42.224428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:42.225222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 221/435] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:42.225910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.247302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:42.338799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850055ff-118e-48dc-ba28-61fb86f1f986 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.353335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e82d1-a882-450b-8d1f-0ec34dae5802 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.389376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.389613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.390168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.390445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.390714 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.391212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.391684 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.392150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.402057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.402739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.403548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.405211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:42.421430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:42.422355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:42.423222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:42.423638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:42.424464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:42.425326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:42.425326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:42.425326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:42.427959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 215/436] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:42.428214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 222/437] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:42.429195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.429498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.481383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:42.540204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18172-be7a-412c-8c7f-9b9ac5c60c91 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.549230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:42.563175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000a7b1-1138-4cac-8ea9-23b908a6e5dc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.575474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.576649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.576928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.577197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.577851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:42.578149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.579510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.587922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 223/438] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:42.588765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.603993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.604640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.604923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.605201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.605864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:42.606166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.607585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0d049-6a72-44f2-8a44-45e8e098e052 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.624103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 216/439] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:42.624103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a825f-4ff8-4b10-9194-8d02a51934e5 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.624103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a825f-4ff8-4b10-9194-8d02a51934e5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.624103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a825f-4ff8-4b10-9194-8d02a51934e5 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.624103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 217/440] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:42.624103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a825f-4ff8-4b10-9194-8d02a51934e5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.701515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89963614-a1f7-4aa4-887f-042254c46d16 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.709274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:42.737976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a825f-4ff8-4b10-9194-8d02a51934e5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.739913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.741332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.741611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.741879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.742565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:42.742866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.744363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.758280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 224/441] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:42.759082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.780576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.781209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.781490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.781907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.792273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.793730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.802339 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-a6518e7d-dfba-45b0-9959-acfc061ca07e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:42.809742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:42.810862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:42.811901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:42.811901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:42.811901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:42.817802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 218/442] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:42.817939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.818986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.819257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.837952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:42.839157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:42.876883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1dffd-6600-4162-b541-5a85c5bb28d2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:42.913951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 219/443] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:42.914493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:42.915125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:42.915402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:42.915672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:42.916006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.932461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:42.934016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:42.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:42.947541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:42.948469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 225/444] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:42.949038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:42.980711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.041812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a097dc7-47d3-498c-aabe-d5f700837458 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.057973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074ef0a-c687-4ed8-b7ee-6a80a63a9342 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.071897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.079075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca19e0-c01d-444b-8523-37d80b4aa934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.079737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca19e0-c01d-444b-8523-37d80b4aa934 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.080008 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca19e0-c01d-444b-8523-37d80b4aa934 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.080277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca19e0-c01d-444b-8523-37d80b4aa934 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/98484e9a9d8d41b8ade7fca3f65d10ae/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.099180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.099912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.100074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.100289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.100947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:43.101242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.102605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.104682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca19e0-c01d-444b-8523-37d80b4aa934 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=98484e9a9d8d41b8ade7fca3f65d10ae, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.106165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca19e0-c01d-444b-8523-37d80b4aa934 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.116090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 226/445] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:43.127216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 220/446] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:42 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/98484e9a9d8d41b8ade7fca3f65d10ae/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:43.127402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.127511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1fd50-327c-40b1-8a4f-6b94753478d2 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.127511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1fd50-327c-40b1-8a4f-6b94753478d2 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.127511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1fd50-327c-40b1-8a4f-6b94753478d2 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.127511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 221/447] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:43.127511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1fd50-327c-40b1-8a4f-6b94753478d2 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.241035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.255793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1fd50-327c-40b1-8a4f-6b94753478d2 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.259625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b67f32-771a-4b6f-bee1-fa12d227beee None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.293418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.293971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.294247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.294554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.299691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.301019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.301019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.301019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.301577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:43.301880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.302509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.303329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.303926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-6f54d18f-9174-40e4-a0bc-3908d3204399 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:43.316613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:43.317530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 222/448] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.326367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.327044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.327110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 227/449] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:43.327110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.338024 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:43.339219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:43.374802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.409876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 223/450] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:43.410904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.441942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6383-6c7a-4728-991a-4f9eb13ad951 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.480145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.481244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.481520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.481788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.493217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:43.498224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:43.499125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:43.499925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 228/451] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:43.501130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.505970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.547305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecaffd-d95e-428a-a0c5-1b7f4f1a8ac9 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.593683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.594959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.595836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.596325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.597281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:43.597801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.600275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.612990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced74c1-79f5-4b23-a3cc-e211e9499845 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.623887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 224/452] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:43.625466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.649421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.650023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.650298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.650617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.660638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.727515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.729027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.732532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.752446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5f2a9-7120-4f55-8221-56acc5aefa22 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.787939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.788577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.788855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.789128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.789783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:43.790082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:43.791440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:43.799856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 225/453] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:43.800653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.838798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 229/454] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:43.839985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:43.899605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.911194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9344c3d-9edf-4090-a297-9f7cf081d3dc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.944185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8e9ff-23d0-452e-8856-603114167b90 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:43.947222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.947222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.947511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.947784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.948119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:43.984834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:43.985639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:43.986643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:43.986938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:43.998463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:44.004191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.005101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:44.006443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 230/455] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.007255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.024112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.025611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.123256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.125976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6edb18-31dc-41a6-8525-72117f40d739 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.139541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 226/456] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:44.141307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.164611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.165234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.165507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.165774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.175635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.177075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:44.191894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.192919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:44.193967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:44.193967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.193967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:44.197538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 231/457] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.198431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.218266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.245896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb438e5f-6031-4741-9681-e0c1413b6abc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.281502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.282128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.282405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.282677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.292965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.294454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.306920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c572-d63b-4043-98f5-68138819a76c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:44.309677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.310647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:44.311485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:44.311485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.311485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:44.312688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 227/458] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.313605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.349345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.349872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.350148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.350423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.351078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:44.351517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.352764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.360323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.366325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 232/459] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:44.367621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.422274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed239-f932-423d-9439-a397cb77480f None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.453862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.458508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.459141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.459423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.459691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.471377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.472884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.476562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acea4cd-aefa-42c5-a063-5c2ca06cab60 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:44.487291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.488197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:44.489069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:44.489069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.489069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:44.489069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 228/460] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.489277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.518249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.518852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.519240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.519512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.520267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:44.520612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.522086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.539015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 233/461] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:44.539015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.593029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.600061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe393-ce3f-4a80-ae1b-6d0edcddc6a3 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.634042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.634641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.634924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.635199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.635827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:44.636125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.637533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.642533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5ac6-93f8-4cd1-b4b3-d8b2723ea7af None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.650063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 229/462] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:44.651266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.679592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.680787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.681569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.682301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.691136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.696768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.699268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:44.717841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.718753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:44.719603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:44.719603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:44.719603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:44.721076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 234/463] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.722123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.760150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2800c4c-03a0-436f-adc8-e7ea8b281c34 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.794258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.795386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.795665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.795939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.796604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:44.796892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.798253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.809440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 230/464] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:44.810799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.828545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.834223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed671c-c4e1-4ffd-a405-91b3c2c0994a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.871675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.873280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.873868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.874334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.882478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.884150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:44.896039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.897165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 235/465] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.898695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:44.922561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad5b0-41a9-4599-b639-24ed5b1c7b1a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:44.951226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:44.958091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:44.958730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:44.959010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:44.959280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:44.965996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:44.967467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:44.978686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:44.979542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:44.980431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 231/466] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:44.980896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.014330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d362-ea6a-46fb-bece-3bfbf061f398 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.052241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.053752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.054036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.054313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.054957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.055258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.056691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.058496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.077889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 236/467] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.077889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.085428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad70f9-153e-4d0b-9369-cdd426576d2a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.123192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.123758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.124039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.124313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.131460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.132943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:45.144841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:45.145771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:45.146620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 232/468] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:45.147078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.194849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325e63-699d-472a-b07f-2e0e9b0d3084 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.208978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.236990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.237970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.238258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.238533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.239595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.240194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.241857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.261422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6680-2705-4caf-bc88-2ffd65357c64 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.266389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 237/469] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.267198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.297612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.298284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.298501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.298775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.299545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.299856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.301323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.302903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.319584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 233/470] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.319584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.376038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26684c15-a67a-4195-a2fa-d5a731eb8799 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.409478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.410115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.410391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.410658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.415996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4406-d20d-4b83-a9ec-4342739af08d None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.417969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.419540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:45.430806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:45.431827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:45.432779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 238/471] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:45.433341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.451937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.452566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.452845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.453117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.453800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.454103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.455531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9829-4567-447b-91eb-a08c18045402 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.460781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.471866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 234/472] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.471866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d99d-07f3-4dbd-8269-172ebcb6b976 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.471866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d99d-07f3-4dbd-8269-172ebcb6b976 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.471866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d99d-07f3-4dbd-8269-172ebcb6b976 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.471866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 235/473] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:45.471866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d99d-07f3-4dbd-8269-172ebcb6b976 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.527605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.538921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd2c53-d75f-4ef6-a4cf-03502431ca76 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.571336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d99d-07f3-4dbd-8269-172ebcb6b976 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.571842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.572478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.572762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.573031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.604238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.604886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.605166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.605441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.606151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=ccb82753b2ec4f0b9386b42fd7f69cee) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.606457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.608443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.614473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 236/474] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/role_assignments?user.id=ccb82753b2ec4f0b9386b42fd7f69cee&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.615173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.653411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.655304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.687875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.725483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698e83-9aad-4971-88f4-23c18d397c8b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.744210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.763653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.764320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.764551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.764823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.765556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.765859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.767295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d9b14-05d7-4902-be9e-b8f05297ff6a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.777664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 239/475] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:45.778891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.791686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 237/476] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.793110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.793405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.793678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.813625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:45.814827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:45.884577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 238/477] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:45.885889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:45.897123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5188b-345e-465b-b35c-580272f792f5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:45.934289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:45.946305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:45.947513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:45.947996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:45.948761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:45.950116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=dd246bbbfb444cd19f8e53157e2973e0) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:45.951424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:45.954200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:45.963415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 240/478] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/role_assignments?user.id=dd246bbbfb444cd19f8e53157e2973e0&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:45.964535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.003640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d595f3-5341-49d8-be1d-fa94e8da1a3e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.014482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.048247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.048966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.049318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.049663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.062231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.063863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:46.081310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:46.082336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:46.083181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:46.083181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:46.083181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:46.083181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 239/479] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:46.087988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.104642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df3743-2746-4cf6-b6f4-9c8060b2b235 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.145550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.146500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.146782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.147056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.235417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.248530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.249998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.276944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5eb8-45ee-4885-8134-8c89624201b8 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.323579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.324209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.324535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.324806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.325444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:46.325776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.327141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.340238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 240/480] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:46.341314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.364081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.388171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 241/481] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:46.389370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.468975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19925a-82cc-4af7-95f8-85890ffcb4ba None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.501348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.508492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.509283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.509624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.509894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.513825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0d09c-8d19-4e00-9988-eedae7e6e59d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.521106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:46.526251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:46.527170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:46.527971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:46.532310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 241/482] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:46.533168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.555774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.557226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.557721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.558406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.566871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.568541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:46.582451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:46.583310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:46.584225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:46.586702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 242/483] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:46.587710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.632742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.659693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdafde-e881-41aa-9657-6a9f90947128 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.705344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.705970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.706243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.706510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.711261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eac7a-07bf-4eed-abf7-c7828d7ba67f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.718304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.719817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:46.735725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:46.736639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:46.737476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:46.737476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:46.737476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:46.737476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 242/484] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:46.738127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.753532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.754782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.755518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.755981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.756854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:46.757368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.758902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.767952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 243/485] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:46.769001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.786299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.847602 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94367a57-f48d-4fdf-a744-3e6af16779a0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.884058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.884796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.885079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.885348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.885980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39215c5-9f06-4a69-9ce6-f5640d8f5a99 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:46.886087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:46.886320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.887763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.900634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 243/486] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:46.901454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:46.904701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:46.925247 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:46.926376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:46.926828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:46.927262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:46.928095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:46.928593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:46.930121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:46.943952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 244/487] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:46.945048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.014790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27a03d-0099-464b-85f3-5185f3bd414b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.036367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:47.057072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.058087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.058508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.058934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.070405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.072005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.072380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156882-f637-43d5-908d-57c7015d371b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:47.088035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:47.089173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:47.090032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:47.090032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:47.090032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:47.092633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 244/488] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:47.093728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.122856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.123540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.123882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.124684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.125542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=0a7700f8cf7049e18a9a530c00bb4d45) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:47.125986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.127685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.134891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 245/489] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:46 2022] GET /identity/v3/role_assignments?user.id=0a7700f8cf7049e18a9a530c00bb4d45&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:47.135668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.168690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:47.259669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdc2a-fea6-4e42-98e7-077b05043546 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.298645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d337-148e-4a79-a5a5-1498d080459b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.299812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.300709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.301216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.301652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.302427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:47.302864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.304380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.312374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:47.319273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 246/490] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:47.327229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.380537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.381460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.381880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.382316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.392077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.393844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:47.408370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:47.409477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:47.410494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:47.412650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 245/491] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:47.417915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.514745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1effe1-9d8c-4837-9eda-6c6b711381de None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.550577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cce9b3-5b0f-4c3a-a70b-f3ccd6f88122 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.552267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:47.556213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.556884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.557155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.558025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.567523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.569651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:47.584031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:47.585181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:47.586081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 247/492] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:47.591824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.598358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.598973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.599253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.599530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.600239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:47.600574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.602006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.619232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 246/493] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:47.626259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.695590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:47.767533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054de8-e6ea-491c-b832-8edbb521f813 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.807439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf57b0-55a8-4b64-a6af-1e10fda770cd None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:47.827765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.828400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.828684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.828954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.829684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:47.829987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.831413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.854040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 248/494] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:47.856412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:47.868525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:47.869778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:47.870264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:47.870738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:47.871665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=9e032cd87fb84d818b509c5af33716ff) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:47.872191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:47.873990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e5746-6b25-483e-92f8-7581be4dce83 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:47.887862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 247/495] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/role_assignments?user.id=9e032cd87fb84d818b509c5af33716ff&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:48.039876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180ac5-fd1c-4974-a4f6-36f36ab42894 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:48.047592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd49e4-a7f0-4f0f-9b8c-15f929c8d156 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.048213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd49e4-a7f0-4f0f-9b8c-15f929c8d156 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.048743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd49e4-a7f0-4f0f-9b8c-15f929c8d156 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.050598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 248/496] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:52:48.063764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:48.066388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.066666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.066945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.104359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab431bd-1980-4728-b8c8-39742701a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:48.104359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab431bd-1980-4728-b8c8-39742701a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.104359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab431bd-1980-4728-b8c8-39742701a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.104359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab431bd-1980-4728-b8c8-39742701a6b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.113444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:48.114691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:48.151571 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:48.193141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab431bd-1980-4728-b8c8-39742701a6b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:48.194656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab431bd-1980-4728-b8c8-39742701a6b5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:48.212384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 249/497] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:48.316051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 249/498] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 26 10:52:48.317583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:48.423611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469595a-e4a5-4487-9d2d-7320a8d74a27 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.423936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469595a-e4a5-4487-9d2d-7320a8d74a27 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.424214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469595a-e4a5-4487-9d2d-7320a8d74a27 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.425578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 250/499] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:52:48.443197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.443468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.443717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.447088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0653e-c676-49e4-8c7e-929463c50716 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:48.480888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:48.482235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:48.482791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:48.483425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.483701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.483974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.496550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:48.498565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:48.500936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:48.517889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:48.518835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:48.519681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:48.519681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:48.519681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:48.519681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 250/500] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:48.528489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:48.541648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:48.583214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 251/501] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:48.584753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:48.674003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df704ba1-831e-4f8c-9027-1898514daf2b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:48.742881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:48.743489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.743766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.744037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.744705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:48.745004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:48.746363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:48.759518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bf808-09c3-47ce-81cc-d6bae47aba9d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:48.767628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 251/502] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:48.773074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:48.796741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:48.797376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.797653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.797925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.808820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:48.814214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:48.817075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:48.819011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 252/503] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:48.824376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:48.830888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:48.901939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:48.934487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23407785-393b-4056-ab31-0bcc1b2fecb3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:48.936353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d5ad-16a7-4c95-a49d-3598cd0ba078 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:48.970945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:48.971575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.971853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.972121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:48.972320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.972752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:48.973031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:48.973304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:48.974062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:48.974370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:48.975819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:48.979345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:48.980877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:48.985184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 253/504] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:48.986005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:48.992808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:48.994848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 252/505] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:48.997044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.065067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:49.103715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ca8f0-16c6-4e9f-9d96-4c1ea3affb45 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.107694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2abc7-dafe-4f61-add3-7f827570e9bd None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.135170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:49.143668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.144597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.144722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.145170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.145321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.145732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.145944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.146165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.158116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.158619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.159706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.160488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:49.175891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:49.176985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:49.177865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:49.177865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:49.177865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:49.177865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 253/506] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:49.178114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:49.185287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:49.186457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:49.187341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:49.187341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:49.187341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:49.189535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 254/507] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:49.190765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.287686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb829-a2f3-4bf5-8172-3d8038c13548 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.315987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f1c75-3061-41fd-96b3-85a03c84e95b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.322215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.322821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.323099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.323371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.324053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:49.324372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.326356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.338856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 254/508] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:49.339667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.341922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:49.358815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.360196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.360728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.361336 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.362178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:49.362677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.364231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.385009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 255/509] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:49.385009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.396209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:49.459720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a61bfa-fd5a-420a-97fb-cd6a26e231fc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.499440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.500848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.501552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.501973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.503011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:49.503462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.505353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.520581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 255/510] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:49.521244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ca00-c768-4ce3-a393-c51174b4afd9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.521841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.562151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.562753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.563023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.563288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.564004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=98484e9a9d8d41b8ade7fca3f65d10ae) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:49.564304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.566278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.573762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 256/511] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:49 2022] GET /identity/v3/role_assignments?user.id=98484e9a9d8d41b8ade7fca3f65d10ae&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:49.574636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.632369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:49.644395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:49.648609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e8f2e-f0ca-4128-a1c2-2c880955641d None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.729469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.730030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.730304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.730572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.743987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4645e-92ce-4cf5-a647-61ace53ede92 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.746720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.748737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:49.774601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:49.775600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:49.776536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 256/512] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Oct 26 10:52:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:49.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:49.800727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cd837-6cc4-4feb-9872-2e5c253e024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.801341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cd837-6cc4-4feb-9872-2e5c253e024d None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.801615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cd837-6cc4-4feb-9872-2e5c253e024d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.801942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cd837-6cc4-4feb-9872-2e5c253e024d None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.802592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cd837-6cc4-4feb-9872-2e5c253e024d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.804118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cd837-6cc4-4feb-9872-2e5c253e024d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:49.833034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 257/513] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:52:49 2022] POST /identity/v3/users => generated 254 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:49.834298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20aaad-0f5f-416c-91b7-146e36803d3b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.834705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20aaad-0f5f-416c-91b7-146e36803d3b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.835065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20aaad-0f5f-416c-91b7-146e36803d3b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.836732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 258/514] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:49.842679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.843060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.843436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.865018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:49.866501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:49.931229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c2c1-fe6e-49ca-b3d7-ec6619295f42 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:49.947567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 259/515] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:49.978074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:49.978696 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:49.979042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:49.979316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:49.980109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:49.980398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:49.982648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:50.003918 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 257/516] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Oct 26 10:52:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:50.009293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.045886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:50.133109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9849-cf30-49fe-a3ac-5f82e2d62c84 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.174638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:50.175295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.175560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.175831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.187553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:50.189068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:50.206356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:50.207330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:50.208870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:50.208870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:50.208870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:50.208870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 260/517] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:50.213462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.249901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:50.285341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.380501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb75516-361d-4776-b61a-27f0069fe7b0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.446306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:50.459980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:50.461010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.461512 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.461966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.462834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:50.463324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:50.464971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:50.488358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 258/518] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:50.492638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.494408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599541c-9856-4890-b1b8-faa829e5a2a8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.563718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:50.564276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.564575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.564842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.565427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:50.569892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9d09f2b0-b96b-4dd5-b6a6-b09bbee67bac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:50.588224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:50.589368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:50.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 261/519] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:50.591056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eca85a-5260-4570-95dd-a1b8ca40faaf None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.591705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eca85a-5260-4570-95dd-a1b8ca40faaf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.596622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eca85a-5260-4570-95dd-a1b8ca40faaf None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.597327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 262/520] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:50.598227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eca85a-5260-4570-95dd-a1b8ca40faaf None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.608937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:50.633536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c01743-bdc1-4cd1-9ab5-a81fa9f661c6 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.669080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:50.669852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.670135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.670400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.677924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:50.679349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-9dfd7073-675d-4a61-b7f5-fe05e0e73f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:50.691860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:50.692824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:50.693714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:50.697863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 259/521] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:50.699041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.699327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.699597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.719528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:50.721083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:50.722800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eca85a-5260-4570-95dd-a1b8ca40faaf None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.760166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:50.761160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.761645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.762146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.763596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:50.764124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:50.765723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:50.775685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 263/522] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:50.776882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.789738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:50.795729 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 260/523] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:50.797016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:50.892859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:50.904974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd59e8-b5cb-4dc3-a4da-665750b97739 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.973046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35789b-c6b8-4195-9414-25618a327027 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:50.987790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:50.989061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:50.989578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:50.989990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:50.990888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:50.991341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:50.992980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:51.001368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 261/524] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:51.033979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:51.034588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:51.034866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:51.035137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:51.035833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:51.036132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:51.037607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:51.051038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 264/525] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:51.057373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:51.083324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:51.208109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:51.251461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b6ef-d621-43c3-a090-787d466dec10 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:51.255133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e9d68-161d-4f6c-a868-764d31f87acc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:51.291559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:51.292615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:51.293391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:51.293672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:51.293942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] PATH_INFO: `/v3/services/network` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:51.295131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:51.297276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:51.298488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:51.299141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:51.300208 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:51.300582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/ccb82753b2ec4f0b9386b42fd7f69cee/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:51.302500 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=ccb82753b2ec4f0b9386b42fd7f69cee, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:51.303913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:51.306391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:51.307424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:52:51.308244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:51.309011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 265/526] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:51 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:51.321701 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:51.333385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 262/527] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:51 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/ccb82753b2ec4f0b9386b42fd7f69cee/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:51.478715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fce6a3-dae9-4c50-a47a-47d6a75cf5ae None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:51.529732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:51.530367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:51.530646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:51.530918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:51.531558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:51.531855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:51.533272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca33b28-7379-4768-adc9-cfa7a2cd63e7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:51.534563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:51.539667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 266/528] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:52:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:51.545216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:51.655219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac1d8-25b4-4846-936a-ac43f45731a9 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:51.690828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:51.691435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:51.691720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:51.691990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:51.692645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:51.692947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:51.694363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1521c7-4d87-441a-89cc-bae5493a3be8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:51.699482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 263/529] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:52:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:52.376439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9417c-fa1b-41f5-b620-f0a3c0cfa930 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:52.376439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9417c-fa1b-41f5-b620-f0a3c0cfa930 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:52.376439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9417c-fa1b-41f5-b620-f0a3c0cfa930 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:52.377642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 267/530] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:52.383723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8bdb-cbed-4f76-996f-2750e68f1e18 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:52.384301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8bdb-cbed-4f76-996f-2750e68f1e18 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:52.384301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8bdb-cbed-4f76-996f-2750e68f1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:52.408899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c64e8bdb-cbed-4f76-996f-2750e68f1e18 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:52.410085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c64e8bdb-cbed-4f76-996f-2750e68f1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:52.478034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:52.499285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 264/531] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:52.597817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15662-ac54-4201-af91-022cc809e5c9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:52.598254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15662-ac54-4201-af91-022cc809e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:52.598644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15662-ac54-4201-af91-022cc809e5c9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:52.600272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 268/532] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:52.617688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:52.617972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:52.618247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:52.640408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:52.641566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:52.728983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 265/533] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:52.923531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c15662-ac54-4201-af91-022cc809e5c9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.037701 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c15662-ac54-4201-af91-022cc809e5c9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.102390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.103209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.103629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.104053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.116691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:53.123799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:53.124960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:53.125981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:53.128230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 269/534] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:53.135812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.135954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.243822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:53.294148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd2485-93c0-4890-97a1-57b03a9a4904 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.311262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:53.332083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0249e9c-7c70-4407-818f-8d46fe4aebb6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.335321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.335987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.336266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.336557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.337216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:53.337513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:53.338879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:53.355734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 266/535] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:53.361424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.413297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.414036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.414319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.414592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.435670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:53.443120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:53.444039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:52:53.444897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:53.449657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 270/536] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:53.454119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.562595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056344-5819-4627-9e82-f0e07060c7a8 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.589895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b29fa-9774-43ff-9eec-223dd1d5a914 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.608562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:53.629228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.629843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.630121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.630395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.631056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:53.631359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:53.632762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:53.653070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.653739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.653862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 271/537] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:53.654022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.654283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.654646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.665810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:53.667359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-4e7a844f-7db2-456d-bc92-fb0861e48f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:53.682498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:53.683497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:53.685926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:53.685926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:53.685926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:53.685926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 267/538] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:53.685926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f85a-3201-47ed-9bef-bb61f6e403de None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.686632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f85a-3201-47ed-9bef-bb61f6e403de None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.686632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f85a-3201-47ed-9bef-bb61f6e403de None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.687640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 268/539] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:53.692305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0f85a-3201-47ed-9bef-bb61f6e403de None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.726672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:53.767171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b8e8-3f09-47a0-af19-569dab0205f9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.802359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.803242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.803670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.804118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.804441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0f85a-3201-47ed-9bef-bb61f6e403de None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.816279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:53.817986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-ad967e2a-48c9-46af-ab09-737558cedeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:53.833244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:53.834197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:53.835078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:53.835078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:53.835078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:53.840584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 272/540] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:53.842413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:53.842780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.843150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:53.843452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.843558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:53.843815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.844174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:53.845535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:53.845535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:53.846353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:53.864284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 269/541] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:53.864284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.870116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:53.871540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:53.899657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:53.945829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 273/542] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:53.947124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:53.972890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808899dd-ca0e-4fbd-b796-f140be02bcbf None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:53.988771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.009991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.010601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.010881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.011156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.011896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:54.012201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.014247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.027215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 270/543] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:54.036001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.061934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dddc8-8e8c-49b9-a1de-b8c4076b2e46 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.107035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.107676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.108004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.108323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.118827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.120973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4f15f6a0-52a2-4770-a975-6c6c5340e759 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:54.136299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:54.137283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:54.139175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 274/544] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:54.139781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63835d2b-7609-4b1a-92e2-607884525e8a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.140103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63835d2b-7609-4b1a-92e2-607884525e8a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.140203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63835d2b-7609-4b1a-92e2-607884525e8a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.145636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 275/545] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:54.147656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63835d2b-7609-4b1a-92e2-607884525e8a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.187480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490023-80c4-490c-9654-f4a7130e2f73 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.188608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.234889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.235527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.235807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.236078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.245759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.247195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-0bd524db-4f1a-42c1-8985-7e95b8ac8ce3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:54.261865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:54.262862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:52:54.263827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:54.267789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 271/546] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:54.269173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.269486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.269910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.281132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63835d2b-7609-4b1a-92e2-607884525e8a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.292121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:54.293327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:54.296762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.319763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.320271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.320599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.320875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.321777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:54.322435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.323871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.349759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 276/547] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:54.349759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.373232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 272/548] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:54.374065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.466417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.488477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff97f6-d87a-4314-a5b6-6d0728fd37ea None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.491300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de139b9-f599-4938-b783-4e2665ba6a40 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.526656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.527262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.527539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.527810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.528480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.528666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.529260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.529534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.529798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.529908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.530506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:54.530804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.532191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30971d42-fa8c-4125-b345-72b51b654f68 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.541914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.549436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 273/549] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:52:54 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:54.550640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.571029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 277/550] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:54.571029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cfc35-cb70-469c-a4f1-e153222cd8fd None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.571029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cfc35-cb70-469c-a4f1-e153222cd8fd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.571029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cfc35-cb70-469c-a4f1-e153222cd8fd None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.571029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 278/551] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:54.572144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cfc35-cb70-469c-a4f1-e153222cd8fd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.690009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c9644-3d1e-4b85-b6d9-f0b756b401d5 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.691536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cfc35-cb70-469c-a4f1-e153222cd8fd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.730185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.730449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.730825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.730930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.731100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.731196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.731371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.731468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.739762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.744891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.745044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:54.746343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.746456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-a57bec70-b287-41f3-ba5c-48da9be152e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:54.761477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:54.762643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:54.763598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:54.763598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:54.763598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:54.763598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 274/552] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:54.764644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.764644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.764830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:54.764900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:54.765738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:54.766614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:54.766614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:54.766614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:54.766614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 279/553] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:52:54.770968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.785209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:54.786406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:54.836400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:54.869782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 275/554] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 26 10:52:54.869782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:54.886730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f646-f2e9-4a4b-b483-c558ce42ee9e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:54.928808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:54.929806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:54.930200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:54.931030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:54.947506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:54.954639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:54.955802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:54.957008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:54.958273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 280/555] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:54.960097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.000689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303d3b-6639-495d-846b-8d7bcaaf0b30 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.017036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.049743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.050793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.051480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.052365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.053512 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:55.054031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.056084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.070659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47524-f398-42fe-86d8-75846562de85 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.071569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 276/556] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:55.072797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.113113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.113840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.114441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.114630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.115427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:55.115831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.117344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.124749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.131064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 281/557] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:55.136468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.208789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76fb3d-153e-4d3e-b7b3-1959acc7d854 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.241927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45d54-4c15-44c8-90dd-499c95a5a9e5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.250681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.252007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.252524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.253423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.253838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.254905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:55.255068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.256699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.270431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 277/558] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:55.270431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.285891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.286525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.286804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.287076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.294410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.295842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:55.307821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:55.308972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 282/559] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:55.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.373435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.376581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff1bfc-0261-4a01-bb5f-f34d2f4e007b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.413492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.414102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.414381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.414653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.418834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760753a5-b07e-4792-90bb-131e2018de41 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.421335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.422754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:55.433851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:55.434797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:55.435673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 278/560] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:55.436866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.458492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.459155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.459376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.459648 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.460293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.461702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.477851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 283/561] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:52:55 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:52:55.478669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.530324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.593637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977383-0eec-4c00-a1f5-1f23158a8d8a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.618191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261fcd8-f0af-42d2-8aac-5832de04cc49 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.633110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.633969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.634319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.634718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.648131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.649821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.659042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.659944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.660428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.660898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.661763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:55.662254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.664549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:55.667929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:55.668917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:55.669849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:55.669849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:55.669849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:55.669849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 279/562] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:55.671400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.682804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 284/563] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:55.683644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.692838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.792765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:55.812956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd17b6-b478-42d1-b706-54bd93c2c645 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.824960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca04867-158b-410f-98e7-9bb6ccfbcba7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:55.848875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.849591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.849753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.850002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.850639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:55.851025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.852401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.866573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 285/564] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:55.871152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.878075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:55.878680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:55.878952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:55.879217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:55.879895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:55.880190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:55.881697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:55.900071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 280/565] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:55.901339 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:55.974987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:56.007985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee511e-4738-4190-96d0-fc8f2603d886 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:56.012082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbb1c7-2a62-449f-bfe3-e23c1bbe6887 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:56.050575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:56.051233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.051512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.051782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/98484e9a9d8d41b8ade7fca3f65d10ae/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.053755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=98484e9a9d8d41b8ade7fca3f65d10ae, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:56.055174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:56.059578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:56.061079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.061565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.062083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.070299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:56.072093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:56.080674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 286/566] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:55 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/98484e9a9d8d41b8ade7fca3f65d10ae/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:56.081708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:52:56.086191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:56.087140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:52:56.088111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:56.095526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 281/567] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Oct 26 10:52:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:56.096955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:56.100961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:56.219132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264acc9-d8d1-466c-8907-8847a2b68bed None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:56.255309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:56.261755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:56.262736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.263228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.263681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.264658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:56.265226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:56.267331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:56.288747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 282/568] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Oct 26 10:52:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:56.295408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:56.299383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f40861-ddbe-40d3-9604-17501a253bdb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:56.369286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:56.369973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.370307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.370515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/4ae3cad6ecec46289d350f4c622442b4/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.402639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=4ae3cad6ecec46289d350f4c622442b4, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:56.404476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:56.413117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551136c2-1aee-4988-8701-fb255137fd02 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:56.433130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 287/569] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:52:56 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/4ae3cad6ecec46289d350f4c622442b4/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:52:56.462966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564f5ea-f65c-4c6c-8527-75a61ae8fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:56.464004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f5ea-f65c-4c6c-8527-75a61ae8fdfe None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.464515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f5ea-f65c-4c6c-8527-75a61ae8fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.465066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564f5ea-f65c-4c6c-8527-75a61ae8fdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.535705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:56.548680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f5ea-f65c-4c6c-8527-75a61ae8fdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:56.550220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564f5ea-f65c-4c6c-8527-75a61ae8fdfe None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:56.658685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 283/570] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:52:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 26 10:52:56.664239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:56.749963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:56.802096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c039-bcaa-48f9-be6e-cd1541c6da87 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:56.846855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:56.847795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.848254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.848757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.860688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:56.862383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:56.865905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b788-0c27-45f2-9654-dd86455bbef8 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.866340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b788-0c27-45f2-9654-dd86455bbef8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.866440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b788-0c27-45f2-9654-dd86455bbef8 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.868100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 284/571] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:56.873855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:56.874140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:56.874417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:56.884384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:56.885428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:56.886307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:56.886307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:56.886307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:56.889884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 288/572] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:56.893161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:56.894558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:56.895280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.012637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 285/573] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:52:57.080114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519c3b0-ae77-494b-b52a-f5d509ac7cca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:57.100361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:57.142449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:57.143430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:57.143914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:57.144422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:57.145289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:57.145803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:57.147403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:57.167582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 289/574] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:57.173265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.199646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:57.315422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a754f1-b157-4c44-99ec-0d52128a9d3b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:57.350144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:57.350758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:57.351033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:57.351296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:57.358651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:57.360328 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:52:57.371343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:57.372267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:57.373736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:57.378142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.396791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.542070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3674a-596a-42de-a11c-17848e52a4ae None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:57.556737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:57.580612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7204b-e5b7-4362-b15f-414488da1ea7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:57.618101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:57.619154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:57.619615 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:57.620097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:57.620960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:57.622363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:57.634747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:57.635834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:57.637307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 287/576] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Oct 26 10:52:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:57.642690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.649073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:57.649703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:57.649985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:57.650263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:57.650966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:57.651269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:57.652742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:57.674398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 290/577] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:57.679814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.719463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:57.774069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a435e7-1ce3-4ebd-ba30-98b40053b83e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:57.803029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc40b40-abbd-49b0-b1e3-a80458caab0b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:57.830791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:57.831325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:57.831607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:57.831882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:57.832527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:57.832828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:57.834301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:57.837758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:57.838363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:57.838643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:57.838970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:57.839691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=ccb82753b2ec4f0b9386b42fd7f69cee) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:57.839798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 288/578] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Oct 26 10:52:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:57.839999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:57.842053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:57.845730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:57.861589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 291/579] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:52:57 2022] GET /identity/v3/role_assignments?user.id=ccb82753b2ec4f0b9386b42fd7f69cee&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:57.876729 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:57.957082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bdff7-4c04-4fb9-8599-ba9f3114bc94 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:58.002879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:58.003509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.003791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.004066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.004732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:58.005037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:58.014152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada7bf-e592-4832-afb5-4bcc4cffba8c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:58.020171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 289/580] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Oct 26 10:52:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:58.026384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:58.098065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f61e-dfb1-45e9-88b2-ed80f005090e None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.098350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f61e-dfb1-45e9-88b2-ed80f005090e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.098622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f61e-dfb1-45e9-88b2-ed80f005090e None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.100079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 290/581] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:58.106048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.106320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.106636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.125585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:58.126763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:58.156220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:58.164027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48acd6-cc01-497a-8ffc-87695f44ce49 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:58.201625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 291/582] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:52:58.205776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:58.206385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.206658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.206925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.207625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] RBAC: Adding query filter params (interface=public, service_id=90c4c0e9e1994e9391a07c9e1005be88, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:58.207925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:58.209307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:58.217301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 292/583] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:52:58 2022] GET /identity/v3/endpoints?service_id=90c4c0e9e1994e9391a07c9e1005be88&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:58.222831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:58.259569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:58.327231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45366f2-7bc8-4625-b8a5-5b22ba994b17 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:58.362665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:58.363196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.363470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.363737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.364353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:58.365711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:58.371160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 292/584] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:52:58 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:58.495934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:58.631040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da402e5b-ed2d-4756-84b2-48a78f6679e1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:58.670783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:58.671507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.671786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.672056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] PATH_INFO: `/v3/services/network` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.672666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:58.674072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-0f747124-84bb-43ec-b8a7-13e622e5dced None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:58.684755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:58.686469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:58.687818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 293/585] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:52:58 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:58.691879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:58.760997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:58.796246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032117d-5ba3-4057-ae01-9b0cc80c9b2f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.796556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032117d-5ba3-4057-ae01-9b0cc80c9b2f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.796825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032117d-5ba3-4057-ae01-9b0cc80c9b2f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.798164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 294/586] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:52:58.798942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb1c49-149c-47e3-8975-88e5c5ca41fc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:58.804111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e1976-9b64-4542-861d-5454b730d03d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.804428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e1976-9b64-4542-861d-5454b730d03d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.804702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e1976-9b64-4542-861d-5454b730d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.828578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-468e1976-9b64-4542-861d-5454b730d03d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:58.830031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-468e1976-9b64-4542-861d-5454b730d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:58.849699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:58.851447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:58.852665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:58.852665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:58.853338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:58.854828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:58.855523 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:58.857654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:58.864784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 293/587] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:52:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:58.874011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:58.949385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 295/588] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:52:58.996409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aaf59-bbf3-4284-a31b-32f8f12624f6 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:59.036631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:59.051088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:59.051702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.051983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.052258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.052922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:59.053224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:59.054604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:59.059752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 294/589] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:52:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:52:59.067807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e1976-9b64-4542-861d-5454b730d03d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:59.226363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e1976-9b64-4542-861d-5454b730d03d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:59.277165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:59.277803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.278083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.278363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.279125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] RBAC: Adding query filter params (interface=public, service_id=a747ccd36e9748a799f777cc8149b224, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:59.279436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:59.280864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:59.294767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:59.295206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 296/590] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/endpoints?service_id=a747ccd36e9748a799f777cc8149b224&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:59.305498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:59.334833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:59.422531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e97b6-cb9a-4403-9522-82cb4d2ba4a0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:59.457011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e68ce-2e12-4ffd-ba4b-7f704e4c88ce None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:59.457980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2f4c-46dc-4fe7-9ac4-f943bb20c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:59.458618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f4c-46dc-4fe7-9ac4-f943bb20c6fc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.458898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f4c-46dc-4fe7-9ac4-f943bb20c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.459170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f4c-46dc-4fe7-9ac4-f943bb20c6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.470656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b2f4c-46dc-4fe7-9ac4-f943bb20c6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-1c3b2f4c-46dc-4fe7-9ac4-f943bb20c6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:52:59.475798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:59.476791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:52:59.477634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 295/591] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:59.478988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54fc3a-f008-4ccd-89e5-de158311727e None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.479280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54fc3a-f008-4ccd-89e5-de158311727e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.479556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54fc3a-f008-4ccd-89e5-de158311727e None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.480954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 296/592] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:52:59.486505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54fc3a-f008-4ccd-89e5-de158311727e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:59.503090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af2d07-22fd-4750-b7e5-ad6fcaa372db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:59.503695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af2d07-22fd-4750-b7e5-ad6fcaa372db None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.503972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af2d07-22fd-4750-b7e5-ad6fcaa372db None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.504246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af2d07-22fd-4750-b7e5-ad6fcaa372db None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.504879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af2d07-22fd-4750-b7e5-ad6fcaa372db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:59.506231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af2d07-22fd-4750-b7e5-ad6fcaa372db None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:59.511778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 297/593] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:59.513015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.513296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.513566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.533835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:52:59.535085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:52:59.565751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:59.612145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 298/594] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:52:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:52:59.642160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54fc3a-f008-4ccd-89e5-de158311727e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:59.696240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:59.696909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.697192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.697466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.698143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:52:59.698449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:59.699933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:59.711279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 297/595] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:52:59.717482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:59.735427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:52:59.836972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1afbca-3c7a-4716-8cc9-2a168df0c8ce None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:52:59.871416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:52:59.872038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:52:59.872361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:52:59.872633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:52:59.882626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:52:59.884120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:52:59.899690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:52:59.900702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:52:59.901762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:52:59.901762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:52:59.901762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:52:59.901762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 299/596] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:52:59.908655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:52:59.990737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.058721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1d09b-fd00-4493-a1c9-d7823891a163 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.090625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.111185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.121189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.121829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.122122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.122891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.125498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:00.125498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:00.127663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:00.154311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 298/597] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:00.159017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.180956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c15aa-aafc-4f68-b0ea-4b3cd01732c0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.245243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.245837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.246123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.246395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.266513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:00.272104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:00.273197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:00.274866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 300/598] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:00.281711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.362484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24ea25-bc6f-4d08-af73-efe1482161fd None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.402029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763c34-9b22-435f-94bf-5880634b8f71 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.424753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.437545 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.438166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.438490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.438774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.439555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:00.439915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:00.441437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:00.451497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 301/599] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:00.453075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.453731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.454015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.454288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.457135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.474363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:00.475820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:00.514204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:00.515191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:00.516573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 299/600] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:00.521914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.561559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a88131-c011-468d-87bc-05d7a796b5ca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.589707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.597381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.598019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.598297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.598565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.610359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:00.611870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:00.627561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:00.629982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:00.632122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:00.632122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:00.632122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:00.632122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 302/601] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:00.638706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.678819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.698887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c0f6b-631a-4f31-8e27-ea93c5064308 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.754743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241151-8239-4e51-ad4f-39cef55344e9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.785155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.785698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.785978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.786249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.786979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:00.787279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:00.788719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:00.794674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:00.795338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:00.795624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:00.795901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:00.796718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:00.797032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:00.798404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:00.810343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 303/602] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:00.816368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.821930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 300/603] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:00.826726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:00.953659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.961464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a448959-eed0-4cbf-8bd6-79ed9afb7def None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:00.968163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:00.977790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200049e2-bda5-443c-8659-9ec147d43905 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.002886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.003923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.004554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.004897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.014913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.016738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.021667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b1a25-16d9-4226-8033-4036d6155ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.022629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b1a25-16d9-4226-8033-4036d6155ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.023087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b1a25-16d9-4226-8033-4036d6155ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.023536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b1a25-16d9-4226-8033-4036d6155ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9267d82b-3a36-4d72-bc62-5eb0d3b799d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:01.030319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:01.031397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:01.032369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 304/604] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:01.037958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3bbf-7ebd-4370-8649-47f9dc4e693e None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.037958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3bbf-7ebd-4370-8649-47f9dc4e693e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.037958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3bbf-7ebd-4370-8649-47f9dc4e693e None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.037958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 305/605] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:01.039396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3bbf-7ebd-4370-8649-47f9dc4e693e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.116620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b1a25-16d9-4226-8033-4036d6155ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.118903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b1a25-16d9-4226-8033-4036d6155ee8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.164089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3bbf-7ebd-4370-8649-47f9dc4e693e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.206266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.206868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.207151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.207437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.208135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:01.208675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.209882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870913b-7996-41d0-970c-dd78b35efd93 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.218019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:01.227459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 306/606] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:01.228915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.229333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.229762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.232239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 301/607] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:01.233778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6daa-43e6-4436-b2d2-4a303be347ff None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.234059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6daa-43e6-4436-b2d2-4a303be347ff None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.234590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6daa-43e6-4436-b2d2-4a303be347ff None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.236462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 302/608] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:01.238657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6daa-43e6-4436-b2d2-4a303be347ff None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.249694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:01.251084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:01.259357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:01.333903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 307/609] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:01.333903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.356056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6daa-43e6-4436-b2d2-4a303be347ff None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.396833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.397478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.397994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.398392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.412546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.414457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-5ec1d9dd-5e08-4981-9791-e2eeaee2b0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:01.430963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:01.431921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:01.432884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:01.432884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:01.432884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:01.434802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 303/610] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:01.436831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.437313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.437836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.452931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986850-a4f5-439d-a171-cc0c18bbf299 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.458121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:01.459509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:01.487906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.488560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.488844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.489118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.501627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:01.512678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:01.543147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 304/611] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:01.545182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.561388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.563000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.673498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436349a0-b4c6-4752-8985-d0778df0bafb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.692210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 308/612] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:01.693394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.711835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.712760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.713179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.713589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.714384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:01.714824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.716923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.734704 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 305/613] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:01.735871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.748412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:01.781924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:01.808054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88974048-8d6c-4321-9873-5c48418b276b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.843032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.843797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.844191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.844587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.845248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.846805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:01.856137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:01.857815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:01.858718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:01.860893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cccc5-b8a4-4595-a9f5-6ff118829fc1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.863190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 309/614] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:01.864678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.897822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:01.898451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:01.898733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:01.899012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:01.910565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:01.912113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:01.927297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:01.928271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:01.929228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:01.929228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:01.929228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:01.929228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 306/615] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:01.929228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:01.972943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95af5ad-d412-4b96-89e6-e8459c4b0a7a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:01.980612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.009214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.009842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.010112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.010379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.017788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.019216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.024471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:02.031728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:02.032719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:02.033666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:02.037634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 310/616] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:02.038456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.040733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1281464-17a7-40cd-86ff-0f063c0e7e2f None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.076889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.077507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.077789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.078059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.078695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.079000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.080430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.090802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 307/617] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.092468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.150029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6bc4-7fce-445a-a5ea-7e583d2bb413 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.186754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.187306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.187586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.187857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.188464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.189821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:02.199471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:02.201041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:02.201909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 311/618] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:02.202694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.204151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b9082-3dde-40c3-b08e-74b0fb250df0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.236495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.239935 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.240566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.240848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.241123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.241753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.242050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.243414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.255205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 308/619] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.255827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.270223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.311529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096823e8-56c5-40a6-99bf-24dfc2ab8ed0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.345614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.346207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.346480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.346743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.347421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.347718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.349148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.354547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce0d2a-5e6c-4743-9461-1a1f47048669 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.360559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 312/620] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.361351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.388742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.389337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.389608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.389881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.390488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.390782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.392123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba7cfd-098f-4ebf-a6cc-61558a84183c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.396323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 309/621] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.397445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a97b-bae7-438e-b342-7bdf8b8eb128 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.397725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a97b-bae7-438e-b342-7bdf8b8eb128 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.397993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a97b-bae7-438e-b342-7bdf8b8eb128 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.404245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 310/622] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:02.404245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5a97b-bae7-438e-b342-7bdf8b8eb128 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.467002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.478782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362754ab-868a-4c90-a2f9-3cbd98426e32 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.496824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.516371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.517003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.517283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.517558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.518202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.518509 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.519921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.524204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5a97b-bae7-438e-b342-7bdf8b8eb128 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.525314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 313/623] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.531310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.564125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.564873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.565265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.565544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.573806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.575364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-08f12bef-7a49-4454-a400-45c2bfa8539a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:02.590058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:02.591543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:02.592553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:02.593574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 311/624] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:02.594783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.595067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.595340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.619414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:02.620721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:02.647992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fe280-1e5e-4e03-af85-8ebde08c382f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.684897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.685739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.686171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.686439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.687171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=98484e9a9d8d41b8ade7fca3f65d10ae) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.687477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.688944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.700666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 312/625] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:02.700666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.706661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 314/626] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/role_assignments?user.id=98484e9a9d8d41b8ade7fca3f65d10ae&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.707556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.740472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.766421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:02.835502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060dd2c-c360-4645-9cc3-46ef0b81f9e4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.845704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030168a-512b-4df0-89a3-80c40cdf7b0b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:02.887206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.887861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.888438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.888438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.889160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.889462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.892452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.908430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 315/627] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.912887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:02.916860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:02.917485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:02.917812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:02.918081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:02.918717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:02.919560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:02.924422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:02.926508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 313/628] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:02.931829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:03.016807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:03.039295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4123a-1ac2-49d2-b139-6addb7355320 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:03.077606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c82d0-108b-45f7-a815-df90513a4dca None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:03.079033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:03.079642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:03.079925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:03.080199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:03.080960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=4ae3cad6ecec46289d350f4c622442b4) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:03.081269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:03.082705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:03.092401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 316/629] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:02 2022] GET /identity/v3/role_assignments?user.id=4ae3cad6ecec46289d350f4c622442b4&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:03.092401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:03.139370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:03.147698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:03.148349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:03.149765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:03.150042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:03.150747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:03.152423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:03.196708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 314/630] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:53:03.268001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65060-a2a4-4552-9606-35fcc0a62c75 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:03.323979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:03.325038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:03.326094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:03.326609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:03.327415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:03.329113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:03.339392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:03.340496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 26 10:53:03.341384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:03.344414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 317/631] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:03 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:03.350488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:03.491498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb0f1-b420-4fed-a62a-8a8cba533f36 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:03.529434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:03.529973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:03.530260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:03.530533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:03.531176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:03.531461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:03.532939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:03.542315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 315/632] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:03.543693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:03.547620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:03.655501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734db1-9ea7-420c-adc3-9d50ca84d2a2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:03.694599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:03.695211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:03.695492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:03.695765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:03.696428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:03.696734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:03.698199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754655-f16a-4e4b-93ae-bc1d1a069de1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:03.708446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 318/633] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:03.710595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:03.782254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:03.846541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26500-a5cc-4acf-9601-aa81cc3587b2 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:03.884661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77ade7-acf0-4ae7-86c9-8733cbe31bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:03.885273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ade7-acf0-4ae7-86c9-8733cbe31bf6 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:03.885553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ade7-acf0-4ae7-86c9-8733cbe31bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:03.885824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ade7-acf0-4ae7-86c9-8733cbe31bf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:03.886506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77ade7-acf0-4ae7-86c9-8733cbe31bf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:03.888443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77ade7-acf0-4ae7-86c9-8733cbe31bf6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:03.916509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 316/634] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:04.835028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beca8f3-b2e6-4b0a-8a63-f48f799b7ce2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:04.835915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beca8f3-b2e6-4b0a-8a63-f48f799b7ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:04.836360 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beca8f3-b2e6-4b0a-8a63-f48f799b7ce2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:04.838073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 319/635] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:04.844303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7634-7dba-4e35-bdb1-2ea675b51569 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:04.845139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7634-7dba-4e35-bdb1-2ea675b51569 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:04.845612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7634-7dba-4e35-bdb1-2ea675b51569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:04.865158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c54e7634-7dba-4e35-bdb1-2ea675b51569 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:04.866643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c54e7634-7dba-4e35-bdb1-2ea675b51569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:04.946273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 317/636] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:05.219081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beca8f3-b2e6-4b0a-8a63-f48f799b7ce2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:05.229899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651df880-47e5-4af6-9b39-36292570dfc6 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.230488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651df880-47e5-4af6-9b39-36292570dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.231001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651df880-47e5-4af6-9b39-36292570dfc6 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.232933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 318/637] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:05.238346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67687a5-c705-4e97-818f-9d9a9f7a88cb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.238855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67687a5-c705-4e97-818f-9d9a9f7a88cb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.239336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67687a5-c705-4e97-818f-9d9a9f7a88cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.257402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d67687a5-c705-4e97-818f-9d9a9f7a88cb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:05.258842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d67687a5-c705-4e97-818f-9d9a9f7a88cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:05.292848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:05.310138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:05.331300 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beca8f3-b2e6-4b0a-8a63-f48f799b7ce2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:05.350016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 319/638] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:05.372937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a89a76-efbb-4b32-bd1b-edfb558d1c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:05.373890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a89a76-efbb-4b32-bd1b-edfb558d1c20 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.374358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a89a76-efbb-4b32-bd1b-edfb558d1c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.374841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a89a76-efbb-4b32-bd1b-edfb558d1c20 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.375730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a89a76-efbb-4b32-bd1b-edfb558d1c20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:05.377363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a89a76-efbb-4b32-bd1b-edfb558d1c20 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:05.396458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 320/639] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:05 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:05.582687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517458d-aaf8-46b1-a22e-7f11874ede9d None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.583050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517458d-aaf8-46b1-a22e-7f11874ede9d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.583247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517458d-aaf8-46b1-a22e-7f11874ede9d None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.584871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 320/640] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:05.590027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.590309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.590581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.609945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:05.611083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:05.626527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517458d-aaf8-46b1-a22e-7f11874ede9d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:05.687685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 321/641] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:05 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:05.743882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517458d-aaf8-46b1-a22e-7f11874ede9d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:05.784186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:05.784877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.785159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.785432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.786025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:05.787495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c6c4f3e2-b8ff-4dcf-ac6a-914133825df7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:05.798134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:05.799189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:05.800636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 321/642] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:05.805488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:05.868806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:05.896476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358b95-6446-4393-a6ef-3ab0e86550ed None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.896985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358b95-6446-4393-a6ef-3ab0e86550ed None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.897061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358b95-6446-4393-a6ef-3ab0e86550ed None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.898557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 322/643] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:05.904153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.904468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.904740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.914303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaf7d0-dd5e-4a42-a187-163292dff646 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:05.923096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:05.924407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:05.953307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:05.960480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:05.961365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:05.961877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:05.962237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:05.963004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:05.963230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:05.964603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:05.974413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 322/644] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:05.974413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.010193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 323/645] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:05 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:06.011005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.100663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5067-e106-43fe-b016-6c5d0f54746f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.120774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:06.140632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0b1e9-c7bb-4ddf-be37-d9dec4805963 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.141536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.142255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.142632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.142993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.154679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:06.159661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:06.160806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:06.161883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:06.167977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 323/646] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:53:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:06.175043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.190009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.190702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.191160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.191522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.192235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:06.192660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.194254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.199429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 324/647] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:06.279638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.293057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf860-abbf-4017-af2c-62ebd26070fa None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.305052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:06.341770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.342966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.343402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.344018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.345326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:06.346045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.347897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.360609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 324/648] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:06.366092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.400501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ea27-bb45-483a-a378-2c2a3e56e0ad None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.427707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:06.438334 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.438966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.439240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.439508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.440078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.441589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:06.451679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:06.452897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:06.454247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 325/649] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:06.458726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.503589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b139e9-a668-44c2-8bf0-63bd6db61c82 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.547956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.548721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.549064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.549418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.550621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:06.562371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.563994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.571591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0271b8-13bb-4872-9a0c-40561d09fd13 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:06.579876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:06.580980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:06.582099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:06.582099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:06.582099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:06.586958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 325/650] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:06.587844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.612320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.613203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.613635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.614057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.614866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:06.615462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.617001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.622252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 326/651] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:06.627887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.712805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:06.717676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded108-b002-444f-83af-a8efea3fbc1f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.765640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.766249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.766528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.766802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.767450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:06.767709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c4aa-e3fb-4556-816e-1c5eb8ace1d7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.767814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.769166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.786853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 326/652] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:06.787901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:06.812245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.812897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.813274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.813555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.814181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:06.814485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.815926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.824375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 327/653] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:06.911630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b6f93-5ac5-45bc-915c-2312ff7fc82a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:06.949561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:06.951119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:06.951615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:06.952070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:06.960900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:06.962615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:06.976319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:06.977600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:53:06.978770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:06.981151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 327/654] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:06.990586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:07.008447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:07.105364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cea5f-1799-4c39-b3ad-38ef8d1bffa9 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:07.142312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:07.142932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.143214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.143490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.144227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:07.144565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:07.146023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:07.167875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 328/655] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Oct 26 10:53:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:07.173868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:07.187633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:07.287851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbf4a9-e7fa-4dd4-a78a-092c31964e78 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:07.323382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:07.324409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.324884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.325941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.337082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:07.338797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:07.354067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:07.355037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:07.355955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:07.355955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:07.355955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:07.358080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 328/656] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:07.364290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:07.435951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:07.472403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7157a-25f5-4ed6-bac6-9c2d91cdfeee None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:07.505862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:07.506713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.507165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.507601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.508481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:07.508929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:07.510425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c676f-a360-4195-a1fb-172bd1dcba3b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:07.523539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 329/657] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:07.529392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:07.599574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:07.641637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72fd3-6adf-43f3-aa1c-5cda02c2f918 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:07.676214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7549-6e4f-4d5f-bd0c-958b95398845 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.676541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7549-6e4f-4d5f-bd0c-958b95398845 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.676826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7549-6e4f-4d5f-bd0c-958b95398845 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.677293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:07.677932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.678206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.678374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 330/658] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:07.678478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.683388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.683675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.683954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.685424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:07.686954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:07.698535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:07.699439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:07.700403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 329/659] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:07.705348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:07.705533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:07.706670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:07.794307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 331/660] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:07 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:07.816763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049da4-7386-412a-b078-b5a6f8f77e39 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:07.841846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:07.854958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:07.856363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:07.856660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:07.856930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:07.857623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:07.857983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:07.859739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:07.873107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 330/661] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:07.878934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:07.939463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:07.982519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929eafb4-72db-44d1-856e-7da1e7e429d3 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:08.017853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:08.018582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.018857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.019130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/4ae3cad6ecec46289d350f4c622442b4/roles/9036fdee1ad34efb9da282b7a7eaec21` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.021255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=4ae3cad6ecec46289d350f4c622442b4, role_id=9036fdee1ad34efb9da282b7a7eaec21)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:08.022670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:08.038510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 332/662] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:07 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/4ae3cad6ecec46289d350f4c622442b4/roles/9036fdee1ad34efb9da282b7a7eaec21 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:53:08.065663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:08.183837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00797f-f618-4e2f-9202-9444dde22f4d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:08.227264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:08.227954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.228235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.228529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.229177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:08.230605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:08.242404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:08.243406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:08.244296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 331/663] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Oct 26 10:53:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:08.251802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:08.368747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bfbe9-9099-4080-bff1-aa7be1f0de96 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:08.392389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:08.409001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:08.409608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.409883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.410150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.410769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:08.411876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:08.413270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3929e0-ee2a-4df9-87be-5d55771a03f8 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:08.418303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 333/664] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:08.424315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:08.471211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff43b43-3606-4526-8b5c-015b74c38f8f None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.471404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff43b43-3606-4526-8b5c-015b74c38f8f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.471677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff43b43-3606-4526-8b5c-015b74c38f8f None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.473031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:08.473437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 334/665] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:08.478477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.478761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.479035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.499434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:08.500657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:08.535386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae6a1d-a3ca-4dea-89e7-643023223a53 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:08.577346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:08.577959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.578238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.578507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.579137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:08.579433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:08.580675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 335/666] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:08 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:08.580790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:08.586128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 332/667] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:08.592466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:08.699648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d371513-39cd-42c5-990f-fdfcac91cd56 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:08.714304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:08.741182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:08.741182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.741182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.741182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.741573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] RBAC: Adding query filter params (interface=public, service_id=e85df72e51bf4f6b87afb5b03e868025, region_id=RegionOne) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:08.741573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:08.741573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:08.748805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:53:08 2022] GET /identity/v3/endpoints?service_id=e85df72e51bf4f6b87afb5b03e868025&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:08.754490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:08.849211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:08.861892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73250dc-f0b2-4f7b-bf50-7e87fa8706c9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:08.874947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:08.904886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9de08-4fe0-459e-a988-85f22822512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:08.905866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9de08-4fe0-459e-a988-85f22822512c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:08.906381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9de08-4fe0-459e-a988-85f22822512c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:08.906889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9de08-4fe0-459e-a988-85f22822512c None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:08.907877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9de08-4fe0-459e-a988-85f22822512c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:08.909616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9de08-4fe0-459e-a988-85f22822512c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:08.916220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 333/669] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:08 2022] GET /identity/v3/services => generated 1029 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:53:08.966407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b1f7c-7d2a-47f9-9213-3a21ad8d6848 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:09.005934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67077de-798b-4d55-b51e-a146c371bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:09.006463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67077de-798b-4d55-b51e-a146c371bcdc None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:09.006739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67077de-798b-4d55-b51e-a146c371bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:09.007007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67077de-798b-4d55-b51e-a146c371bcdc None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:09.007678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67077de-798b-4d55-b51e-a146c371bcdc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:09.009142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67077de-798b-4d55-b51e-a146c371bcdc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:09.030094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 337/670] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:08 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:53:09.189553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b0b6-3328-4990-8d06-16b9201e9aca None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:09.190095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b0b6-3328-4990-8d06-16b9201e9aca None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:09.190095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b0b6-3328-4990-8d06-16b9201e9aca None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:09.191766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 334/671] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:09.197580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ebf5b-e69a-4e6d-ac0c-c3aa867ab213 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:09.197872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ebf5b-e69a-4e6d-ac0c-c3aa867ab213 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:09.198131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ebf5b-e69a-4e6d-ac0c-c3aa867ab213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:09.217602 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c49ebf5b-e69a-4e6d-ac0c-c3aa867ab213 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:09.218806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c49ebf5b-e69a-4e6d-ac0c-c3aa867ab213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:09.258481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:09.306872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 338/672] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:09 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:09.579361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b0b6-3328-4990-8d06-16b9201e9aca None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:09.685804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b0b6-3328-4990-8d06-16b9201e9aca None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:09.722333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd8546-7461-41f0-8db9-cc6c8c1ddaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:09.723294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8546-7461-41f0-8db9-cc6c8c1ddaf5 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:09.723769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8546-7461-41f0-8db9-cc6c8c1ddaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:09.724234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8546-7461-41f0-8db9-cc6c8c1ddaf5 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:09.725146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd8546-7461-41f0-8db9-cc6c8c1ddaf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:09.726912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd8546-7461-41f0-8db9-cc6c8c1ddaf5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:09.746693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 335/673] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:09 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:10.404058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435ba6-7090-4af0-acc3-c4f5f96ecfce None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:10.404578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435ba6-7090-4af0-acc3-c4f5f96ecfce None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:10.404578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435ba6-7090-4af0-acc3-c4f5f96ecfce None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:10.406144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 339/674] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:10.411276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:10.411699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:10.411879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:10.430499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:10.431676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:10.459084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:10.509381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 336/675] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:10.779025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435ba6-7090-4af0-acc3-c4f5f96ecfce None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:10.881674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435ba6-7090-4af0-acc3-c4f5f96ecfce None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:10.916855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:10.917481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:10.917753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:10.918019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:10.928956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:10.933683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:10.934675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:10.936050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 340/676] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:53:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:10.940726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.065319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f702bd-970c-4aa9-a20d-c08800222fd8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.104009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253143-153a-41cb-a3da-05424090b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.104731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253143-153a-41cb-a3da-05424090b993 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.105007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253143-153a-41cb-a3da-05424090b993 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.105277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253143-153a-41cb-a3da-05424090b993 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.105954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253143-153a-41cb-a3da-05424090b993 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:11.106281 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253143-153a-41cb-a3da-05424090b993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.107650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253143-153a-41cb-a3da-05424090b993 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.117084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 337/677] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Oct 26 10:53:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:11.122793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.146076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ce844-6497-40d5-8650-2ed371ba3044 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.146380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ce844-6497-40d5-8650-2ed371ba3044 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.146627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ce844-6497-40d5-8650-2ed371ba3044 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.147939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 338/678] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:11.152954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d0f88-32c8-42b8-94ae-19b48d5d67a9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.153797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d0f88-32c8-42b8-94ae-19b48d5d67a9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.154054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d0f88-32c8-42b8-94ae-19b48d5d67a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.156121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.174131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-779d0f88-32c8-42b8-94ae-19b48d5d67a9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:11.175361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-779d0f88-32c8-42b8-94ae-19b48d5d67a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:11.194574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.245681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd070-34bf-4d22-84f1-3ec9c1de443a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.248989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 339/679] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:11.284251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.284906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.285179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.285445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.295767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.297219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.304689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29faa-a4f3-4948-bc5e-f631893d3b6f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.305026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29faa-a4f3-4948-bc5e-f631893d3b6f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.305305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29faa-a4f3-4948-bc5e-f631893d3b6f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.307890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 340/680] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:11.311840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:11.312094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:11.313110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:11.314022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:11.314022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:11.314022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.314194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.314194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.314319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 341/681] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:11.318647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.335087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:11.336408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:11.420358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 341/682] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:11.439754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62bbf5-fbeb-4f08-9fb4-9e091afdf30e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.446947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.475244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.475906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.476189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.476524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.477161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:11.477465 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.478828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.495535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 342/683] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:11.501510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.526170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.603035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.629480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9958e-0c08-4409-a04c-7a72c86bffad None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.643006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcb786-52d4-46e3-b5ca-2bf54f9c4680 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.675778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.676954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.677384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.677866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.680996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.681343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.681690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.682036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.682683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.684209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.687112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.687950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.690186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:11.696846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:11.697997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.704608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 343/684] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:11.705596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:11.712407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:11.714461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 342/685] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:11.716749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.808894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc56331-49d3-4148-b57a-2d2059c11d6d None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.822404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecdf1c-4009-473b-ba5c-8332de3773db None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.844176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.844907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.845185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.845450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.846140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.847620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.857236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:11.857379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:11.858324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:11.859187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:11.860196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:11.860196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:11.860196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:11.860196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:11.860196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:11.861070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:11.863757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 344/686] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:11.864656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.868593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 343/687] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:11.868593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:11.879432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.931858 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:11.973241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad34cc6-dbc2-4f3f-9e1e-e7757ce1b68a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:11.982220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624838d-fc96-4353-84d4-a0e1fb06ed71 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.007905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.008537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.008809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.009077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.009773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:12.010066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.011461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.018739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.019346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.019625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.019895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.020568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:12.020868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.022220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.031377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 344/688] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:12.031377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.036386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 345/689] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Oct 26 10:53:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:12.036386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.099486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.131550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7af93-71d6-4ee8-80a4-ca88b9daada6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.139275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601933-79f3-4eb5-b81b-dc27500c0a6b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.161869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.163996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.164614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.164885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.165150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.165768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:12.166061 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.167412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d73c8-7b02-4919-8ab0-c4983d4702e0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.172610 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 345/690] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:12.173730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9bfd-9bf6-4dca-bb1f-c0bb8ab15d9d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.173983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9bfd-9bf6-4dca-bb1f-c0bb8ab15d9d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.174247 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9bfd-9bf6-4dca-bb1f-c0bb8ab15d9d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.174345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.174960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.175246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.175520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.176147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:12.176449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 346/691] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:12.176547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.177741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a9bfd-9bf6-4dca-bb1f-c0bb8ab15d9d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.177859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.187330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 346/692] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:12.187330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.277323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a9bfd-9bf6-4dca-bb1f-c0bb8ab15d9d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.280809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171103-84c8-4004-8f03-7082daea3aff None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.318056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.318661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.318934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.319201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.321320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4e483-c8bc-45a5-b472-58181d8fd453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.321729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.321976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e483-c8bc-45a5-b472-58181d8fd453 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.322730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e483-c8bc-45a5-b472-58181d8fd453 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.323004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e483-c8bc-45a5-b472-58181d8fd453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.324618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4e483-c8bc-45a5-b472-58181d8fd453 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.326058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4e483-c8bc-45a5-b472-58181d8fd453 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.357030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 347/693] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:12.357030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.357030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.357030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.382478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:12.384294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:12.399720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.401213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.434189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.486586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 348/694] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:12.486586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.551112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 347/695] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:12.556994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.615181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.648897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8624fc-d446-4c1a-a7cf-9fb9ef87f1ad None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.721778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8cb26-2abd-4b47-a8ca-49512ef27ad5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.730676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.731343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.731771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.732048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.733600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] RBAC: Adding query filter params (interface=public, service_id=bef33d8d25eb483d92d166c1a51f4103, region_id=RegionOne) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:12.733914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.735634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.741638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 349/696] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/endpoints?service_id=bef33d8d25eb483d92d166c1a51f4103&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:12.746982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.767741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.768450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.768675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.768946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.780731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.782181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.790937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:12.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:12.799141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:12.800044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:12.800044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:12.800044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:12.800044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 348/697] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:12.800737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.863929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38505-65fc-4185-8c36-0acd657ab141 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.891085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:12.899300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.899845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.900125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.900423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.901028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.902384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.907700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503d48-9781-4e34-b4cc-16399f7b79fe None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:12.916569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 350/698] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 10:53:12.916569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:12.955016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:12.955712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:12.955989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:12.956256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:12.956870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:12.958239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:12.968505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:12.969590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:12.970469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 349/699] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:12.975639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.062364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:13.070689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d061-dda8-44c6-93d6-a2cbda9bdaa4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.116189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af2be-cbf4-432c-b557-f4f017176e63 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.120078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.121155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.121155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.121358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.121932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:13.122228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.125294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.140983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 351/700] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:13.143142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.156759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.157285 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.158040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.158338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.158971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:13.159591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.161273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.167747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 350/701] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:13.174652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.197949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:13.275015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef8664-6ff0-4f82-86b8-07d2547064ae None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.297732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e944f1-372a-48c0-8b13-25c7d458fb2c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.322625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.323262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.323795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.324068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.334715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.336418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.336560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.337283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.337637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.337968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.338949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:13.339746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.341902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:13.350902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:13.351847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:13.353405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 352/702] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:13.353988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 351/703] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:13.354467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.359983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.377798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:13.445605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:13.470293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079ae4f-8540-4887-8070-7137cb385d03 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.493693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2602fa-d5ce-47f5-8f4f-b2a8e9d247a5 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.505398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.506269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.506797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.507278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.508152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:13.508669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.510289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.522983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 352/704] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:13.531989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.536441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.537255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.537695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.538118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.539402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] RBAC: Adding query filter params (interface=public, service_id=a310ce70a4c14c5893b8e9ca8cf54e2d, region_id=RegionOne) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:13.539876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.541788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.549546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 353/705] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:53:13 2022] GET /identity/v3/endpoints?service_id=a310ce70a4c14c5893b8e9ca8cf54e2d&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:13.556446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:13.638155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b83020-e651-47cf-8c7a-4564b7fb2d95 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.673403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.674001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.674274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.674543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.675340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] RBAC: Adding query filter params (role.id=9036fdee1ad34efb9da282b7a7eaec21, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=4ae3cad6ecec46289d350f4c622442b4) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:13.675550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.677089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbc96-1561-4af1-882d-84f137f1a502 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.679041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:13.688496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 353/706] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:13 2022] GET /identity/v3/role_assignments?user.id=4ae3cad6ecec46289d350f4c622442b4&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=9036fdee1ad34efb9da282b7a7eaec21 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:13.692965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6648b-5d11-4166-8b42-cb14cc1b91f5 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:13.733341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f921-bdad-43fc-892b-a0c803b5d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:13.734347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f921-bdad-43fc-892b-a0c803b5d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:13.735108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f921-bdad-43fc-892b-a0c803b5d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:13.735574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f921-bdad-43fc-892b-a0c803b5d0d2 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:13.736410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6f921-bdad-43fc-892b-a0c803b5d0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:13.738028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6f921-bdad-43fc-892b-a0c803b5d0d2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:13.745708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 354/707] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:13 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 10:53:14.646006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288f3e9-1223-4009-88f2-498a7142a0ec None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:14.646536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288f3e9-1223-4009-88f2-498a7142a0ec None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:14.646536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288f3e9-1223-4009-88f2-498a7142a0ec None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:14.648119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 354/708] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:14.654517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed940d4-626d-4c48-b8b3-d48990cadbc0 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:14.655050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed940d4-626d-4c48-b8b3-d48990cadbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:14.655050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed940d4-626d-4c48-b8b3-d48990cadbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:14.675496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6ed940d4-626d-4c48-b8b3-d48990cadbc0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:14.676735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6ed940d4-626d-4c48-b8b3-d48990cadbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:14.746811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 355/709] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:15.023307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288f3e9-1223-4009-88f2-498a7142a0ec None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:15.026206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:15.135333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288f3e9-1223-4009-88f2-498a7142a0ec None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:15.170110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:15.170798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.171081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.171353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.172030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:15.173215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399dc1e-f3c6-4e25-b7d0-29f83ce1c7cb None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.173445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:15.173549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399dc1e-f3c6-4e25-b7d0-29f83ce1c7cb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.173827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399dc1e-f3c6-4e25-b7d0-29f83ce1c7cb None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.175310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 356/710] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:15.180273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.180587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.180860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:15.182535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:15.183495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:15.185042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 355/711] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:15.190352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:15.202608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:15.204031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:15.262512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:15.287772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 357/712] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:15.317249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d34a1f-37cd-4a84-aef9-e0de5f3e9597 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:15.352685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:15.353287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.353564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.353833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.354455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:15.354754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:15.356092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:15.361640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 356/713] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:15.367106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:15.371724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:15.472796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f0801-1267-4e19-ae55-e33765ec90d4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:15.508907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:15.509519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.509796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.510067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.510702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:15.511005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:15.512371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:15.517902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 358/714] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:15.595777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:15.708235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c14c6c-e812-4537-8d10-ed0dd56fba04 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:15.740583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:15.746642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:15.747878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.748372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.749031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.749626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:15.750985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-d1c75d31-73cf-4209-900b-b88b9d29fa2b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:15.760298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:15.761307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:15.762153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 357/715] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:15.767717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:15.845551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:15.879763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649008ff-6767-4085-8d57-bc002af60f10 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:15.917022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4850-d41d-4910-b02d-8a686bcdc504 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.917396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4850-d41d-4910-b02d-8a686bcdc504 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.917678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d4850-d41d-4910-b02d-8a686bcdc504 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.920362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 358/716] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:15.920967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:15.921574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.921853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.922121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.922745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:15.923043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:15.928206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:15.929789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0614-6ea8-4f44-95b5-45bbb3481d7d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:15.930170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0614-6ea8-4f44-95b5-45bbb3481d7d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:15.930540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0614-6ea8-4f44-95b5-45bbb3481d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:15.933315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 359/717] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:15.938894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:15.949678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-715c0614-6ea8-4f44-95b5-45bbb3481d7d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:15.951280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-715c0614-6ea8-4f44-95b5-45bbb3481d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:16.027545 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 359/718] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:16.028994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ec178-a693-4765-ab6c-5cdbd101af8b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.029352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ec178-a693-4765-ab6c-5cdbd101af8b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.029695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ec178-a693-4765-ab6c-5cdbd101af8b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.031001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 360/719] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:16.036292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.036602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.036876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.049012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fc10d-ddd8-47aa-bbf5-9fcdc776e8c3 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.059798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:16.061851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:16.082727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:16.088447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.089305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.089887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.090364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.091086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:16.091455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.092932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.103194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 360/720] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:16.104217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.154784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 361/721] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:16.218722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d2d1-03f7-422d-885d-a426d9561306 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.254788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.255727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.256204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.256696 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.257595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.259242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.285340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 361/722] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:16.315692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.379354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:16.424517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.428930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2442e5-3b0d-443b-b73a-87606ed5c9f4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.472140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.472809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.473088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.473357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] PATH_INFO: `/v3/services/image` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.473990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.475426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:16.485861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:16.486913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:16.487737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 362/723] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Oct 26 10:53:16 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:16.493541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.501826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:16.563925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fd10-0417-4b1f-9213-aaca76e18d33 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.605583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.607011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.607288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.607552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.608405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.610710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.615755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101190f8-8e42-4385-a1c8-4c4f2b625c1c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:16.621734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:16.623247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 26 10:53:16.624063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:16.625260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 362/724] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:16.629232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.638138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:16.662340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.662952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.663228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.663498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.664117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] RBAC: Adding query filter params (name=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:16.664447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.666134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.672673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 363/725] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:16.678490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.747554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48628-7541-4cb9-b0da-b8a5784f9462 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.769125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:16.792466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.793334 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.793612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.793944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.794573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:16.794873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.796695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.804894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 363/726] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:16.811309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338cd05-dc2e-4882-96fa-70ae042be5ab None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.811785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:16.848277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.848999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.849303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.849487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.850355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] RBAC: Adding query filter params (type=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:16.850463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.852556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.857573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 364/727] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:16.939885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47512c9-95aa-4012-9f60-6e0afb4d667e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:16.978341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:16.979265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:16.979691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:16.980142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:16.980960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:16.981441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:16.983029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7007d5-b316-40f2-a06c-148643d75c44 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:16.989432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 364/728] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Oct 26 10:53:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:16.998443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:17.048188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:17.113544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a2ea-64c5-43f5-9290-9c12049c33fb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:17.147708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49d091-6dd7-483d-97c1-35daea467638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:17.148325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d091-6dd7-483d-97c1-35daea467638 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:17.148623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d091-6dd7-483d-97c1-35daea467638 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:17.149021 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49d091-6dd7-483d-97c1-35daea467638 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:17.149697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49d091-6dd7-483d-97c1-35daea467638 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:17.151040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49d091-6dd7-483d-97c1-35daea467638 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:17.180841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 365/729] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:17.805008 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3be95-e96a-46a3-86fd-b620c1b15b34 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:17.805564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3be95-e96a-46a3-86fd-b620c1b15b34 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:17.805564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3be95-e96a-46a3-86fd-b620c1b15b34 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:17.807163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 365/730] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:17.812580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c822f-f65a-43c9-8515-9d9ede12d309 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:17.812979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c822f-f65a-43c9-8515-9d9ede12d309 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:17.813183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c822f-f65a-43c9-8515-9d9ede12d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:17.831872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4c8c822f-f65a-43c9-8515-9d9ede12d309 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:17.833091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4c8c822f-f65a-43c9-8515-9d9ede12d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:17.907152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 366/731] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:18.181310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3be95-e96a-46a3-86fd-b620c1b15b34 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:18.230928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:18.292127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3be95-e96a-46a3-86fd-b620c1b15b34 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:18.328474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93e579-1b04-4665-bd8c-bc3d4a7eecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:18.329420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93e579-1b04-4665-bd8c-bc3d4a7eecbd None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:18.329928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93e579-1b04-4665-bd8c-bc3d4a7eecbd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:18.330401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93e579-1b04-4665-bd8c-bc3d4a7eecbd None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:18.331356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93e579-1b04-4665-bd8c-bc3d4a7eecbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:18.332988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93e579-1b04-4665-bd8c-bc3d4a7eecbd None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:18.352505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 366/732] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:18 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:18.569857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971793dd-98f8-424d-b780-e8d184f6f618 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:18.570225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971793dd-98f8-424d-b780-e8d184f6f618 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:18.570418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971793dd-98f8-424d-b780-e8d184f6f618 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:18.571882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 367/733] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:18.577670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:18.578218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:18.578707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:18.596995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:18.598479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:18.676171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 367/734] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:18.943332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971793dd-98f8-424d-b780-e8d184f6f618 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:18.971272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:19.060637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971793dd-98f8-424d-b780-e8d184f6f618 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:19.097453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:19.098090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.098365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.098633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.099215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:19.100588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-da67b61a-5f30-463f-8ce4-37496bca104e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:19.110160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:19.111187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:19.112026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 368/735] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:19.119195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:19.129828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adc9a0-c468-4d05-96d3-ec9c8f6e57a5 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.130111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adc9a0-c468-4d05-96d3-ec9c8f6e57a5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.130822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adc9a0-c468-4d05-96d3-ec9c8f6e57a5 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.132915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 369/736] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:19.141131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.141786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.142069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.156731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:19.163705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:19.164936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:19.242630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea688915-954e-4067-b889-329b5c8e2d40 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:19.252413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 370/737] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:19.281565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:19.282256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.282528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.282795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.283490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:19.283795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:19.285557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5fc0-7f8c-4b18-a379-cef852e36754 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:19.294805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 368/738] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:19.300568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:19.320787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:19.412946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60980-ea35-409e-81d5-f340cf9d8578 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:19.447928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7ecf1-623d-42d7-b02b-6dffb7c42653 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.448232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7ecf1-623d-42d7-b02b-6dffb7c42653 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.448510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7ecf1-623d-42d7-b02b-6dffb7c42653 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.450468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 369/739] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:19.451684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:19.452274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.452574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.452836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.453458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:19.453750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:19.455087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:19.457075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.457568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.458040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.460546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 371/740] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:19.466654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:19.481233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:19.482702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:19.562648 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:19.567471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 370/741] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:19.568294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:19.588060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee7e48-f1ba-40d5-a501-46dae2e18769 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:19.601777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:19.630972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:19.632118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.632958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.633442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.634371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] RBAC: Adding query filter params (interface=admin, service_id=bef33d8d25eb483d92d166c1a51f4103, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:19.634883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:19.637267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:19.644518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 372/742] 10.222.0.49 () {56 vars in 1249 bytes} [Wed Oct 26 10:53:19 2022] GET /identity/v3/endpoints?service_id=bef33d8d25eb483d92d166c1a51f4103&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:19.650164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:19.694953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85924c-f786-4951-a4d5-b288a6bf6d12 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:19.732405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:19.733559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.734059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.734522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.735617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:19.737441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:19.752713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6efc2c-82a9-4ebf-be65-fe77dbf29750 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:19.757658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 371/743] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:19 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:19.797175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:19.797799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:19.798079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:19.798351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:19.798958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:19.800345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:19.807831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 373/744] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:19 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:53:19.865424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:19.973069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:19.995860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434bd9b-6bf9-4968-96e6-dfd20efef81a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:20.035050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:20.035896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:20.036318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:20.036752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:20.037561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:20.039119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:20.041896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING keystone.server.flask.common [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 26 10:53:20.065052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.sql.core [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 26 10:53:20.065052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:53:20.065052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [parameters: {'id': '84deb27209e74a8cbb235f35e6954637', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 26 10:53:20.065052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84deb27209e74a8cbb235f35e6954637.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84deb27209e74a8cbb235f35e6954637. Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:53:20.072888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 26 10:53:20.073834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application yield resource Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise self.value Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application session.commit() Oct 26 10:53:20.075597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:53:20.076649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:53:20.077529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:53:20.078309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [parameters: {'id': '84deb27209e74a8cbb235f35e6954637', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:20.079285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:20.080238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84deb27209e74a8cbb235f35e6954637. Oct 26 10:53:20.081734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:20.083907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 372/745] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Oct 26 10:53:19 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:20.089775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:20.102458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:20.202396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff21b-5d5e-4418-902c-e6fbbeadc8a5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:20.239313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:20.239991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:20.240274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:20.240568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:20.248225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:20.249689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-93b2374b-1abc-4db0-8aef-3f071a16b279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:20.261253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:20.263116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:20.264977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 374/746] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:20.268782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:20.376487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a137-6026-42c7-b6ab-155fc7126e75 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:20.412737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:20.413361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:20.413638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:20.413962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:20.414628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] RBAC: Adding query filter params (name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:20.414928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:20.416584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742b14-8027-43d2-a7da-b6cb3fb25447 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:20.432785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:20.440149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 373/747] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:20.610723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11273c-b61a-4780-afdd-3a6d72ed8c7a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:20.611003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11273c-b61a-4780-afdd-3a6d72ed8c7a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:20.611277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11273c-b61a-4780-afdd-3a6d72ed8c7a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:20.612956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 375/748] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:20.618482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:20.618774 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:20.619052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:20.640365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:20.641898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:20.715804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 374/749] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:20 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:20.988739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11273c-b61a-4780-afdd-3a6d72ed8c7a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:21.058984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:21.100359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11273c-b61a-4780-afdd-3a6d72ed8c7a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:21.131893 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:21.132558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:21.132837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:21.133109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:21.133696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:21.135046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:21.144609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:21.145668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:21.146503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 376/750] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:21.153984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:21.260099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b0388-3113-43de-b7a8-9a9924237948 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:21.290522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:21.298628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:21.299464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:21.299921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:21.300422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:21.301233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:21.301717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:21.303256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:21.309329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 375/751] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:21.315157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:21.416853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2273f0-843a-4c78-946a-61f3c8a2832d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:21.448962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:21.452105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:21.452797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:21.453656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:21.453656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:21.454288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:21.454594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:21.455997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:21.462546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 377/752] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:21.469178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:21.571954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0eb27-e387-426d-8567-e18aacd638c4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:21.608635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:21.609243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:21.609521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:21.610054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:21.610751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] RBAC: Adding query filter params (interface=public, service_id=53239e8a7e564562bfd168ec062cb231, region_id=RegionOne) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:21.611056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:21.612444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d0d86-5ef7-44c1-a751-0f6674ac42be None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:21.618037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 376/753] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:53:21 2022] GET /identity/v3/endpoints?service_id=53239e8a7e564562bfd168ec062cb231&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:21.623726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:21.726938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670444a5-e9c3-4c99-8e8a-104a46a7cd51 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:21.761767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710099bd-3241-4e44-84d6-6ceb521e19c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:21.762905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710099bd-3241-4e44-84d6-6ceb521e19c6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:21.763182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710099bd-3241-4e44-84d6-6ceb521e19c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:21.763447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710099bd-3241-4e44-84d6-6ceb521e19c6 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:21.764040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710099bd-3241-4e44-84d6-6ceb521e19c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:21.765415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710099bd-3241-4e44-84d6-6ceb521e19c6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:21.772276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 378/754] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:21 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:53:22.062498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796194-3a0b-454c-862a-1badbdd23647 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.062985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796194-3a0b-454c-862a-1badbdd23647 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.063331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70796194-3a0b-454c-862a-1badbdd23647 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.065081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 377/755] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:22.070410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.070697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.070969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.089736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:22.091472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:22.107592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c427-1181-4bb0-a90d-c3d1db44f7d5 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.107870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c427-1181-4bb0-a90d-c3d1db44f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.108140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c427-1181-4bb0-a90d-c3d1db44f7d5 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.109491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 378/756] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:22.114710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.114991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.115260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.133838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:22.135026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:22.154071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:22.172922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 379/757] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:22.199382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:22.214346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 379/758] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:22.444368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:22.488132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:22.552681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc31694-045f-4ec6-8934-9a603cf2769b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:22.595847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309b1c9-d3dd-4d0e-a24a-4878b2370b20 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:22.598285 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:22.599896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.600275 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.600670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] PATH_INFO: `/v3/services/image` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.601357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:22.602805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:22.615561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:22.616849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:22.617889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:22.620377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 380/759] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:22.629263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:22.642746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:22.643485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.643826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.644159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.644881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:22.646384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:22.657265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:22.658350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 26 10:53:22.659190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:22.664054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 380/760] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:22.665436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:22.700749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:22.739119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:22.757750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce0d02-bb14-4e83-84f8-a20eb028f339 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:22.792631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:22.793234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.793543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.794323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.794939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:22.795231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:22.796598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef68dc-c210-4078-b8a6-fb5d1759fea2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:22.797310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f32e-7fb7-4973-9898-f897dc88ea6c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:22.805960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 381/761] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:22.805960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921b62-1cfb-4395-8283-07779a8d6aa0 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.805960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921b62-1cfb-4395-8283-07779a8d6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.805960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921b62-1cfb-4395-8283-07779a8d6aa0 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.805960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 382/762] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:22.808501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b921b62-1cfb-4395-8283-07779a8d6aa0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:22.834354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:22.834953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.835234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.835500 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.836118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:22.836449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:22.837798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63f9b-fea9-4380-9fdf-a39e28df4307 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:22.843172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 381/763] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:22.844260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.844568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.844837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.863425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:22.864651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:22.924781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b921b62-1cfb-4395-8283-07779a8d6aa0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:22.940409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 382/764] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:22.940409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:22.941322 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:22.960552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:22.961276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:22.961615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:22.961954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:22.962673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] RBAC: Adding query filter params (type=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:22.963033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:22.964514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:22.977288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 383/765] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:22.978641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:23.021496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:23.086639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99582cfc-f053-4f2d-b04b-a033980a2c1a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.110627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df83e1-9537-45d7-8aab-dd16d378416b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.131736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.133229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.133717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.134452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.135610 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] RBAC: Adding query filter params (interface=public, service_id=75032e6ae5ba4ad6bab2563d777bff2b, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:23.136577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.138717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.146732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 384/766] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/endpoints?service_id=75032e6ae5ba4ad6bab2563d777bff2b&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:23.151620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.152233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.152541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.152801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.153465 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:23.153768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.153989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:23.155132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.164914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 383/767] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Oct 26 10:53:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:23.166394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:23.212428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:23.275350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b937b-4ae8-42cd-9a94-e507418b0ff3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.278741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30bc51-6a6b-4859-abeb-562f4b6e58f4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.289912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:23.311124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.311952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.312070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.312260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.312889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.314240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.317014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.317634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.317898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.318169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.318825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.320166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.322041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 385/768] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:53:23 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:53:23.322954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:23.350195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 384/769] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:23.463503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d127774-1cc6-425e-9d29-0683e43692a4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.474320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:23.512277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.513432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.513704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.513973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.514624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.516132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.518894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING keystone.server.flask.common [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 26 10:53:23.534578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.sql.core [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 26 10:53:23.534578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 26 10:53:23.534578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [parameters: {'user_id': '5049180872cb4733a3bdb8b6c5237af1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 26 10:53:23.534578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81545) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result.read() Oct 26 10:53:23.552502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:53:23.553486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application yield resource Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise self.value Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application session.commit() Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:53:23.554418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:53:23.556938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:53:23.559766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result.read() Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:53:23.561681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [parameters: {'user_id': '5049180872cb4733a3bdb8b6c5237af1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:23.563373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 26 10:53:23.565456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:23.568632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 386/770] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Oct 26 10:53:23 2022] POST /identity/v3/users => generated 160 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:23.569513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:23.681398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf5c94-b459-4f57-a906-273030d41ecc None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.718700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.719671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.720151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.720642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.729344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.731082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-048eef13-87bb-47fc-a9f0-230d3359d739 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:23.743728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:23.744870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 26 10:53:23.745808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:23.749161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 385/771] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:23.757679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:23.861745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abff92b-485a-4aa5-989e-a9268bf13230 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:23.897909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:23.898534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:23.898812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:23.899080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:23.899788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:23.900087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:23.901842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d33e-b53a-4e58-a4db-3e18be7d263a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:23.950352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 387/772] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Oct 26 10:53:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:24.032306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c103-b226-41e1-b6d0-d347d4ac6511 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:24.032621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c103-b226-41e1-b6d0-d347d4ac6511 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:24.032806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c103-b226-41e1-b6d0-d347d4ac6511 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:24.034522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 386/773] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:24.040395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:24.040687 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:24.040960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:24.060689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:24.062594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:24.083171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:24.150943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 388/774] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:24.419298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c103-b226-41e1-b6d0-d347d4ac6511 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:24.451241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:24.525265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c103-b226-41e1-b6d0-d347d4ac6511 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:24.558785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:24.559958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:24.560230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:24.560531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:24.561099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:24.562439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:24.571073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:24.572796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 26 10:53:24.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:24.576403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 387/775] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:24.578409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:24.680495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5974d6-228b-4908-b0fd-9daea2516e80 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:24.715086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:24.715883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:24.716260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:24.716654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:24.717383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:24.717913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:24.719477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:24.729720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 389/776] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:24.731819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:24.826084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:24.833859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf11f-f306-4c89-96fd-207df77fc658 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:24.867319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:24.867915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:24.868185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:24.868479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:24.869093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:24.869387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:24.870718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793794c1-5d9f-421b-9576-e4f5794a9600 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:24.876093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 388/777] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Oct 26 10:53:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:24.881748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:24.901564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:24.985139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d83a-887b-4e0d-b46c-380b9b528c25 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:25.018603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d789a-e267-4521-9b33-cf4528d1903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:25.019397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d789a-e267-4521-9b33-cf4528d1903d None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:25.019775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d789a-e267-4521-9b33-cf4528d1903d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:25.020144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d789a-e267-4521-9b33-cf4528d1903d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:25.021035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d789a-e267-4521-9b33-cf4528d1903d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:25.022530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d789a-e267-4521-9b33-cf4528d1903d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:25.052356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 390/778] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:53:25.611252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b43e2-7adb-4e35-9bff-1985ea49010c None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:25.611776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b43e2-7adb-4e35-9bff-1985ea49010c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:25.611856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b43e2-7adb-4e35-9bff-1985ea49010c None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:25.613213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 389/779] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:25.618350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:25.618755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:25.618919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:25.633824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1043-e010-41a1-b308-0c3de9109138 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:25.634111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1043-e010-41a1-b308-0c3de9109138 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:25.634390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1043-e010-41a1-b308-0c3de9109138 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:25.635722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 390/780] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:25.639081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:25.640273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:25.641234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:25.641522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:25.641798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:25.661247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:25.662441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:25.714380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:25.723646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 391/781] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:25.733391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 391/782] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:25.991803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:26.001534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:26.092488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:26.104691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3cc0c-ae4e-4ab1-8ad8-f81731441f1d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:26.109871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113aec9-07da-4cd7-a0aa-79b3635962af None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:26.140369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:26.141327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:26.141767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:26.142047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] PATH_INFO: `/v3/services/image` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:26.142626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:26.143986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:26.146648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:26.147426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:26.147864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:26.148277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:26.149506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:26.151065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:26.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:26.153823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:26.154937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 392/783] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Oct 26 10:53:25 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:26.155908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 392/784] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:26.161238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:26.161485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:26.228054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:26.269061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21e40d-6a6f-487e-89e2-064e82396523 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:26.274366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6b25-fcd0-4d24-b11a-a4acb5132e51 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:26.305721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:26.306445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:26.306723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:26.306999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:26.307644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:26.309664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:26.312739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:26.313552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:26.314014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:26.314475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:26.315108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] RBAC: Adding query filter params (name=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:26.315409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:26.316824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:26.326516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 393/785] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:26.327381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:26.340410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 393/786] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:26 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:26.444912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c94df3-acdc-421d-97ac-a227cca75e00 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:26.473066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:26.484193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:26.485107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:26.485386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:26.485656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:26.486297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] RBAC: Adding query filter params (type=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:26.486598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:26.487997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aaac4-8545-412f-936c-adec8fd15666 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:26.498139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 394/787] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:26.499725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:26.511590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:26.604485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702d1-e5c8-4858-92c9-93f6d8cf9e6c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:26.638406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02dfa-3b69-4d57-8baa-0c8ba464b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:26.639020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02dfa-3b69-4d57-8baa-0c8ba464b6b3 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:26.639286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02dfa-3b69-4d57-8baa-0c8ba464b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:26.639558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02dfa-3b69-4d57-8baa-0c8ba464b6b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:26.640229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02dfa-3b69-4d57-8baa-0c8ba464b6b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:26.641618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02dfa-3b69-4d57-8baa-0c8ba464b6b3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:26.662275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 394/788] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:53:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:27.266532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03edefd-86d3-4159-a872-b3496c39276f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.267065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03edefd-86d3-4159-a872-b3496c39276f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.267065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03edefd-86d3-4159-a872-b3496c39276f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.272382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 395/789] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:27.274145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.274435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.274705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.293196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:27.294932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:27.354705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:27.372377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 395/790] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:27.634583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03edefd-86d3-4159-a872-b3496c39276f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:27.736982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03edefd-86d3-4159-a872-b3496c39276f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:27.770642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a9305-e888-4774-b557-0806710829df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:27.771554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a9305-e888-4774-b557-0806710829df None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.772067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a9305-e888-4774-b557-0806710829df None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.772594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a9305-e888-4774-b557-0806710829df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.783210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a9305-e888-4774-b557-0806710829df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5b1a9305-e888-4774-b557-0806710829df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:27.788206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:27.789210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:27.790054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 396/791] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:53:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:27.795904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:27.899964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21201b-dc1d-42bd-bdba-cc48eec9c6c3 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:27.934546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:27.935157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:27.935432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:27.935701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:27.936359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:27.936669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:27.938019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:27.946248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 396/792] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Oct 26 10:53:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:27.952694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a9305-e888-4774-b557-0806710829df None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.007007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.053925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a9305-e888-4774-b557-0806710829df None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.086547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.087165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.087439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.087706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.100243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.101736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:28.117039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:28.117967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:28.118843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:28.118843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:28.118843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:28.120415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 397/793] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:28.123963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.178859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.227026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3717f1-e0f2-45cf-8ad7-600d3f922283 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.260454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.261058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.261331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.261611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.262802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:28.263097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.264470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.276363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 397/794] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:28.282261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.380593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d48d5-1d2b-49fd-adf7-c17ffd909d43 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.382898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.415703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.416344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.416641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.416913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.424711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.426177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-8812afb6-599c-4bae-87f5-21e14401e531 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:28.438814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:28.439874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:53:28.441398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:28.442274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 398/795] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:28.446059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.550003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f4b36-a36c-4486-8c61-bbb058db8384 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.552025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9911e-7d96-4233-ac38-ef144763ac2d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.552308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9911e-7d96-4233-ac38-ef144763ac2d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.552615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9911e-7d96-4233-ac38-ef144763ac2d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.553948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 399/796] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:28.559345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.559623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.559895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.564314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.578465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:28.579664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:28.588842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.589459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.589721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.589986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.591291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:28.591588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.593019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.616058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 398/797] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:28.617089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.660503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 400/798] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:28.716929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df2f3-9091-448b-b243-85b21fe11d72 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.755097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.755737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.756008 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.756271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.767104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.768558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-5d3a8404-3df1-4119-816f-157e55b9017d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:28.783376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:28.784307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:28.791552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:28.791552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:28.791552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:28.791552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 399/799] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:28.791779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.848280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0e51-3246-4bdc-a54d-473ca7d825c6 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.848855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0e51-3246-4bdc-a54d-473ca7d825c6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.848855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0e51-3246-4bdc-a54d-473ca7d825c6 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.850172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 400/800] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:53:28.855276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.855558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.855880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.879436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:28.880963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:28.887178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.895273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d4d4-5c81-405a-8068-7ffd7730bdcb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:28.898545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:28.932008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:28.932656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:28.932935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:28.933207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:28.933845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:28.934184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:28.935658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:28.946867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 401/801] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:28.947649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:28.952718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 401/802] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:28.952718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.055265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cefb8-8dec-41bb-b5b4-8f3512406288 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.059942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b124-d170-42b0-be4b-2fb0aa84b4ef None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.089494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.090129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.090964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.091237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.101975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.102326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.102608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.102884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.103153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.103779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.104457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.106046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.107909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 402/803] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:29.113494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:29.115291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:29.116157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.117623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 402/804] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:29.121908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.135882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:29.142954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:29.225641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d62e8a-354a-408c-8c50-1f98a12e3b8d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.225926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8f29-59b2-45f2-b6a1-45b4655f44cd None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.258349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.258720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.258948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.259225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.259318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.259497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.259599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.259826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.260129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.260526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:29.260828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.261579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.262764 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.274262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 403/805] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:29.275397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.290224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 403/806] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:53:29 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 10:53:29.291551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.354140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:29.391524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f918e-e78a-4003-afd8-7bfc01b5cd5e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.399047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:29.428720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa200b-3859-4424-ae22-7d28a53419ae None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.430504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.431203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.431549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.431895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.432682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.434682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.443119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.sql.core [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:53:29.443119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:53:29.443119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [parameters: {'id': '9b8dcd1cede84a5b882685955a6a6631', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:53:29.443119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:53:29.451689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 26 10:53:29.452914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application yield resource Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application next(self.gen) Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.rollback() Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.force_reraise() Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise self.value Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application session.commit() Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 26 10:53:29.458078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._prepare_impl() Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.session.flush() Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._flush(objects) Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application compat.raise_( Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application flush_context.execute() Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rec.execute(self) Oct 26 10:53:29.459197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 26 10:53:29.460266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result = self._query(query) Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application conn.query(q) Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application result.read() Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 26 10:53:29.461921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [parameters: {'id': '9b8dcd1cede84a5b882685955a6a6631', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 26 10:53:29.463031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:29.463997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.465152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 404/807] 10.222.0.49 () {60 vars in 1137 bytes} [Wed Oct 26 10:53:29 2022] POST /identity/v3/domains => generated 190 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:29.465948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.480853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.481522 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.481974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.482266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/ccb82753b2ec4f0b9386b42fd7f69cee/roles/9036fdee1ad34efb9da282b7a7eaec21` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.486829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=ccb82753b2ec4f0b9386b42fd7f69cee, role_id=9036fdee1ad34efb9da282b7a7eaec21)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.488259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.502814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 404/808] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:29 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/ccb82753b2ec4f0b9386b42fd7f69cee/roles/9036fdee1ad34efb9da282b7a7eaec21 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:53:29.586145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917210-9857-47e1-8bc2-c690fce04700 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.623033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.623697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.624050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.624432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.627619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:29.639269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.640886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c154aeab-0681-4985-9e2e-3e6629ce725e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:29.656673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:29.657889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:29.658992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:29.658992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:29.658992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:29.659913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 405/809] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:29.665770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:29.769746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33033d-104a-4e44-8693-1fcd09a00b6f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:29.803303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:29.803914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:29.804190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:29.804564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:29.805206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:29.805504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:29.806859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a51a2-2c1c-4a03-88fc-60b3505537da None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:29.814512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:29.821912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 405/810] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:31.473079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b45a9-217a-4628-8aa2-3c82b3ddaef6 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.473632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b45a9-217a-4628-8aa2-3c82b3ddaef6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.473632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b45a9-217a-4628-8aa2-3c82b3ddaef6 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.474870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 406/811] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:31.480148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee5c1-5633-4d80-a19a-6b73ff86fdd9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.480614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee5c1-5633-4d80-a19a-6b73ff86fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.480717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee5c1-5633-4d80-a19a-6b73ff86fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.498626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-650ee5c1-5633-4d80-a19a-6b73ff86fdd9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:31.499799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-650ee5c1-5633-4d80-a19a-6b73ff86fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:31.568674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 406/812] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:31.645609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d086b6-3e5b-4898-a74c-0dc6c948075b None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.645895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d086b6-3e5b-4898-a74c-0dc6c948075b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.646171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d086b6-3e5b-4898-a74c-0dc6c948075b None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.647493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 407/813] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:31.652759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.653047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.653321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.671004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:31.672178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:31.738051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 407/814] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:31.832763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d086b6-3e5b-4898-a74c-0dc6c948075b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:31.934296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d086b6-3e5b-4898-a74c-0dc6c948075b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:31.966878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:31.967499 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:31.967779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:31.968051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:31.979410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:31.985049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:31.986205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:31.987156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 408/815] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:31.992108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.001780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.049563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.052579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.098001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c474b4-7714-4163-b0d3-2632b3844dc1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.103128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c16856-83d8-441d-806f-f1009c3290c0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.131334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.131938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.132214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.132515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.133170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:32.133471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.134827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.137701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.138328 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.138607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.138883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.143458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 408/816] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:32.149156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.149459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:32.154795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:32.155896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:32.156807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 409/817] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:32.161546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.247986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559fe21-7f4f-4667-aab1-c9c85c927b7b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.259355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c269dd-3d50-4735-9d86-067f71cb3c41 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.266889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.268215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.282077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.282701 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.282980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.283257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] PATH_INFO: `/v3/users/14e3060ccf5c49ec9e6bff54f50f6728` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.292555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.293152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.293953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.294224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.294870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:32.295165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.296547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.296837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] RBAC: Authorizing `identity:get_user(user_id=14e3060ccf5c49ec9e6bff54f50f6728)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.298256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.299846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 409/818] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/users/14e3060ccf5c49ec9e6bff54f50f6728 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:32.304305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 410/819] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:32.305513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.310546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.402123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a26f23-52a2-4b78-be6e-489eaa45f1eb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.409732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae49a-3290-4f6d-99d8-36c5d570ae34 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.445949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.446608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.446889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.447161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.459205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.460729 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:32.477071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:32.478566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:32.479449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:32.479449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:32.479449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:32.479449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 411/820] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:32.485099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.511278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.550556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.551245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.551531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.551800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] PATH_INFO: `/v3/projects/4f5d490ead904854968740aa13734889` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.552927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] RBAC: Authorizing `identity:get_project(project_id=4f5d490ead904854968740aa13734889)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.554340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.555953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 410/821] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/projects/4f5d490ead904854968740aa13734889 => generated 311 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:32.561823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.586631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e13b-cdb5-483e-9877-352d3daa6e90 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.607774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.621471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.622070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.622348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.622619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.623253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:32.623553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.624951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.636516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 412/822] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:32.641980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.659435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c42a10-cc43-4c46-addb-348349c8a22a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.692619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.693271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.693550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.693822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] PATH_INFO: `/v3/projects/4f5d490ead904854968740aa13734889/users/14e3060ccf5c49ec9e6bff54f50f6728/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.696046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5d490ead904854968740aa13734889, user_id=14e3060ccf5c49ec9e6bff54f50f6728, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.697483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.711321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 411/823] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:32 2022] PUT /identity/v3/projects/4f5d490ead904854968740aa13734889/users/14e3060ccf5c49ec9e6bff54f50f6728/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:53:32.726019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.747197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6060-dede-464f-9c71-34d8c4f15129 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.785095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.785659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.785934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.786201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.794095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.795560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:53:32.808419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:32.814519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:32.815624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 413/824] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:32.817482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:32.919666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39c90-811a-4a74-b728-be4f742db30d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:32.926468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:32.953872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:32.954471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:32.954747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:32.955016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:32.956078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:32.956401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:32.957802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:32.974843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 412/825] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:32.980873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:33.078925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e6f9f-3cf7-4527-a776-c20352765228 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:33.116083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:33.116717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:33.116995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:33.117266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:33.129604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:33.184438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:33.185879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:33.285046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 414/826] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:33.286220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:33.382023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d28a-d5df-41d2-8bac-c73b951a3ab6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:33.414806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:33.415430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:33.415704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:33.415972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:33.425704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:33.427124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:53:33.441647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:33.447652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:53:33.448680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:53:33.448680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:53:33.448680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:33.448680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 413/827] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:33.448915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:33.490360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:33.545576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ead94-8f20-47d4-a922-5bec81b7543a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:33.580355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:33.580991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:33.581280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:33.581557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:33.582215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:33.582520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:33.583894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:33.595861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 415/828] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:33.601485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:33.620304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:33.700603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bf7dc-6e94-46cb-9889-13104b019099 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:33.733693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:33.734306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:33.734585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:33.735111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:33.741546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:33.742959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:53:33.754391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:33.755465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:33.756402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 414/829] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:53:33.761383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:33.860455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc95cac-03d3-4cf3-ac1d-b50e6a14ceda None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:33.861964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:33.896647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:33.897252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:33.897534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:33.897808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:33.898495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:33.898799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:33.900233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661dc9-2d0d-48be-ab2c-8205fa84d76b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:33.913224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 416/830] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:33.919784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:33.993172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:34.015001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c79c0-d413-4c7e-9015-11cc69c2ea77 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:34.047630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:34.048221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:34.048524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:34.048796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:34.049516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] RBAC: Adding query filter params (role.id=9036fdee1ad34efb9da282b7a7eaec21, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=ccb82753b2ec4f0b9386b42fd7f69cee) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:34.049824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:34.051241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927882c7-86ba-464a-b89c-9920fa837b70 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:34.056854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 415/831] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:33 2022] GET /identity/v3/role_assignments?user.id=ccb82753b2ec4f0b9386b42fd7f69cee&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=9036fdee1ad34efb9da282b7a7eaec21 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:53:34.844563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc8f4-a329-4b1a-9c0f-8bd20df1edd5 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:34.845109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc8f4-a329-4b1a-9c0f-8bd20df1edd5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:34.845109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc8f4-a329-4b1a-9c0f-8bd20df1edd5 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:34.846431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 417/832] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:34.851762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:34.852189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:34.852355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:34.871917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:34.873155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:34.936941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 416/833] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:35.202469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc8f4-a329-4b1a-9c0f-8bd20df1edd5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.300266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc8f4-a329-4b1a-9c0f-8bd20df1edd5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.333409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.334018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.334295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.334565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.344897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:35.349675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:35.350757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:35.352039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 418/834] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:35.356683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.425320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.454832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9b52d-cd32-4289-b343-09a218feeab0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.486565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.487148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.487419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.487685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.488327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:35.488654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.489987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.498092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 417/835] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:35.503938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.528488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.601306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40720d80-5daf-4c5b-92ec-70ad6fdbe8e1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.634287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.634908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.635188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.635464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] PATH_INFO: `/v3/users/14e3060ccf5c49ec9e6bff54f50f6728` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.636599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] RBAC: Authorizing `identity:get_user(user_id=14e3060ccf5c49ec9e6bff54f50f6728)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.638608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.640148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 419/836] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/users/14e3060ccf5c49ec9e6bff54f50f6728 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:35.645765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:35.740428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81399e8e-564d-4108-af6f-136d7634021b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:35.768390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:35.773555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:35.774134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:35.774406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:35.774669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:35.838201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:35.839616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:35.932741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 418/837] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:35.939122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.026073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.035799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f413e-cbdd-425f-8d20-a9e66dc661c1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.069312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230b612-ff76-4234-84f1-6cdbd4b68d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.069928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230b612-ff76-4234-84f1-6cdbd4b68d70 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.070207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230b612-ff76-4234-84f1-6cdbd4b68d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.070480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230b612-ff76-4234-84f1-6cdbd4b68d70 None admin] PATH_INFO: `/v3/projects/4f5d490ead904854968740aa13734889` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.071572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230b612-ff76-4234-84f1-6cdbd4b68d70 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5d490ead904854968740aa13734889)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.073011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230b612-ff76-4234-84f1-6cdbd4b68d70 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.074669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 420/838] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:53:35 2022] GET /identity/v3/projects/4f5d490ead904854968740aa13734889 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:36.080731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:36.111541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:36.177849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539753fb-0d5c-4a84-8255-fe57464f1ac8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:36.209535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:36.210070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:36.210344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:36.210612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:36.211325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=4f5d490ead904854968740aa13734889, user.id=14e3060ccf5c49ec9e6bff54f50f6728) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:36.211628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:36.213065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc71f0a-0da5-454c-a8c0-3db3c0a71149 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:36.219077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 419/839] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:36 2022] GET /identity/v3/role_assignments?user.id=14e3060ccf5c49ec9e6bff54f50f6728&scope.project.id=4f5d490ead904854968740aa13734889&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:38.341012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3ea3-833b-4a30-a5a0-c87e9aa8ecef None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:38.341565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3ea3-833b-4a30-a5a0-c87e9aa8ecef None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:38.341565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3ea3-833b-4a30-a5a0-c87e9aa8ecef None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:38.342861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 421/840] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:38.348247 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:38.348683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:38.348792 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:38.367133 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:38.368296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:38.431945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 420/841] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:38.701515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3ea3-833b-4a30-a5a0-c87e9aa8ecef None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:38.801535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3ea3-833b-4a30-a5a0-c87e9aa8ecef None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:38.834167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cbf8f-ebfa-4d71-bf73-303495606965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:38.834785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cbf8f-ebfa-4d71-bf73-303495606965 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:38.835060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cbf8f-ebfa-4d71-bf73-303495606965 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:38.835326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cbf8f-ebfa-4d71-bf73-303495606965 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:38.836427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cbf8f-ebfa-4d71-bf73-303495606965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:38.837912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cbf8f-ebfa-4d71-bf73-303495606965 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:38.839461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 422/842] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:38.845752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:38.872292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:38.944028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a30be-fc55-4f8b-aea9-aa96136e91ab None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:38.978060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b0e3a-644f-4c42-84f9-94e9758921b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:38.978586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b0e3a-644f-4c42-84f9-94e9758921b8 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:38.978861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b0e3a-644f-4c42-84f9-94e9758921b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:38.979126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b0e3a-644f-4c42-84f9-94e9758921b8 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:38.979773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b0e3a-644f-4c42-84f9-94e9758921b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:38.981242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b0e3a-644f-4c42-84f9-94e9758921b8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:39.002603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 421/843] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:53:38 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:41.165682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12bd69-61af-4771-b5bc-9d351e799890 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.166162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12bd69-61af-4771-b5bc-9d351e799890 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.166252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12bd69-61af-4771-b5bc-9d351e799890 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.167554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 423/844] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:41.172711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.173157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.173249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.191004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:41.192179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:41.255905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 422/845] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:41.525467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12bd69-61af-4771-b5bc-9d351e799890 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:41.551842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:41.624345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12bd69-61af-4771-b5bc-9d351e799890 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:41.656750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:41.657352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.657629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.657896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] PATH_INFO: `/v3/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.659248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] RBAC: Authorizing `identity:get_role(role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:41.660621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:41.661885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 424/846] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:41 2022] GET /identity/v3/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:41.667580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:41.681140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:41.765937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1db01-604b-4618-94ca-5862877d9895 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:41.798148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:41.798710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.798989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.799263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] PATH_INFO: `/v3/users/be9de47a4567400882b9f576712de15e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.812807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] RBAC: Authorizing `identity:get_user(user_id=be9de47a4567400882b9f576712de15e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:41.814225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:41.815782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 423/847] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:41 2022] GET /identity/v3/users/be9de47a4567400882b9f576712de15e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:41.821401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:41.911859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:41.919364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd2a3-1428-479e-be37-1ebec64370e0 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:41.952518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2ad35-960c-44c6-bed3-c77c4fa4e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:41.953133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ad35-960c-44c6-bed3-c77c4fa4e07b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:41.953411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ad35-960c-44c6-bed3-c77c4fa4e07b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:41.953684 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ad35-960c-44c6-bed3-c77c4fa4e07b None admin] PATH_INFO: `/v3/projects/4f5d490ead904854968740aa13734889` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:41.954776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ad35-960c-44c6-bed3-c77c4fa4e07b None admin] RBAC: Authorizing `identity:get_project(project_id=4f5d490ead904854968740aa13734889)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:41.956180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ad35-960c-44c6-bed3-c77c4fa4e07b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:41.957796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 425/848] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:53:41 2022] GET /identity/v3/projects/4f5d490ead904854968740aa13734889 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:41.963505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:42.029709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:42.059505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e473a-d20e-486c-8d2d-f6652323cdd6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:42.090619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7764e64-a187-4c11-a860-7bafa80a1835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:42.091251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764e64-a187-4c11-a860-7bafa80a1835 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:42.091553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764e64-a187-4c11-a860-7bafa80a1835 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:42.091827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764e64-a187-4c11-a860-7bafa80a1835 None admin] PATH_INFO: `/v3/projects/4f5d490ead904854968740aa13734889/users/be9de47a4567400882b9f576712de15e/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:42.093983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7764e64-a187-4c11-a860-7bafa80a1835 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5d490ead904854968740aa13734889, user_id=be9de47a4567400882b9f576712de15e, role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:42.095383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7764e64-a187-4c11-a860-7bafa80a1835 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:42.109398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 424/849] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:41 2022] PUT /identity/v3/projects/4f5d490ead904854968740aa13734889/users/be9de47a4567400882b9f576712de15e/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:53:44.218766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dcee7-0889-4369-8808-56cd2a4a37c0 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.219275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dcee7-0889-4369-8808-56cd2a4a37c0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.219367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dcee7-0889-4369-8808-56cd2a4a37c0 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.220671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 426/850] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:44.226148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.226552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.226694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.247357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:44.248579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:44.312131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 425/851] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:44.580153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dcee7-0889-4369-8808-56cd2a4a37c0 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.677491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dcee7-0889-4369-8808-56cd2a4a37c0 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.709196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.709803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.710075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.710343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] PATH_INFO: `/v3/roles/c4333dc639d7498fbb17ff5eaeac2457` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.711681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] RBAC: Authorizing `identity:get_role(role_id=c4333dc639d7498fbb17ff5eaeac2457)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.713040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.714304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 427/852] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/roles/c4333dc639d7498fbb17ff5eaeac2457 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:44.720471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.776966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.816398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373e46-8d6b-44be-bbc1-f02fc4a041f7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.849158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.849717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.849995 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.850269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] PATH_INFO: `/v3/users/be9de47a4567400882b9f576712de15e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:44.851374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] RBAC: Authorizing `identity:get_user(user_id=be9de47a4567400882b9f576712de15e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:44.852823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:44.854366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 426/853] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/users/be9de47a4567400882b9f576712de15e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:44.860270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:44.889659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:44.956824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05ae3b-8b02-4edf-be1b-0d4aaec43fc1 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:44.989484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:44.990068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:44.990343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:44.990608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.054141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.055560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.083192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.151282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 428/854] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:45.157679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.252945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3258221-68a5-4e47-ac9e-6325158a7af6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.278498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.286310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190abf9-c5bb-4ba1-8b8e-4637a72fc641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.286923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190abf9-c5bb-4ba1-8b8e-4637a72fc641 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.287199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190abf9-c5bb-4ba1-8b8e-4637a72fc641 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.287474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190abf9-c5bb-4ba1-8b8e-4637a72fc641 None admin] PATH_INFO: `/v3/projects/4f5d490ead904854968740aa13734889` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.288579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190abf9-c5bb-4ba1-8b8e-4637a72fc641 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5d490ead904854968740aa13734889)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.289983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190abf9-c5bb-4ba1-8b8e-4637a72fc641 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.291573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 427/855] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/projects/4f5d490ead904854968740aa13734889 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:45.298496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:45.408991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae15848-4805-451a-8512-ccd09b795353 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:45.436869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:45.442881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:45.443481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:45.443761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:45.444036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:45.444780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] RBAC: Adding query filter params (role.id=c4333dc639d7498fbb17ff5eaeac2457, scope.project.id=4f5d490ead904854968740aa13734889, user.id=be9de47a4567400882b9f576712de15e) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:45.445088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:45.446513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf983e-33fc-43e5-815a-885c01b40a02 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:45.452173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 429/856] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:45 2022] GET /identity/v3/role_assignments?user.id=be9de47a4567400882b9f576712de15e&scope.project.id=4f5d490ead904854968740aa13734889&role.id=c4333dc639d7498fbb17ff5eaeac2457 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:47.567306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482d2b-5ca9-46d4-bc72-c7ff3e92748c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:47.567805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482d2b-5ca9-46d4-bc72-c7ff3e92748c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:47.567805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482d2b-5ca9-46d4-bc72-c7ff3e92748c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:47.569152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 428/857] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:47.574923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:47.575338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:47.575467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:47.593280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:47.594467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:47.660103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 430/858] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:47.927374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482d2b-5ca9-46d4-bc72-c7ff3e92748c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:48.023960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482d2b-5ca9-46d4-bc72-c7ff3e92748c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:48.056174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef1ea9-ffc0-49b4-ac2d-e0b5ac17daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:48.056800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1ea9-ffc0-49b4-ac2d-e0b5ac17daa1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.057073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1ea9-ffc0-49b4-ac2d-e0b5ac17daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.057337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef1ea9-ffc0-49b4-ac2d-e0b5ac17daa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.058427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef1ea9-ffc0-49b4-ac2d-e0b5ac17daa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:48.059836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef1ea9-ffc0-49b4-ac2d-e0b5ac17daa1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:48.061368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 429/859] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:48.066921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:48.165630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58519b-d5ad-4dcd-94b6-76c4c12cbf9c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:48.188253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:48.199063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83abf-9193-47bf-94ab-5ed5fb15609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:48.199665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83abf-9193-47bf-94ab-5ed5fb15609c None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:48.199937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83abf-9193-47bf-94ab-5ed5fb15609c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:48.200204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83abf-9193-47bf-94ab-5ed5fb15609c None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:48.200863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83abf-9193-47bf-94ab-5ed5fb15609c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:48.202265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83abf-9193-47bf-94ab-5ed5fb15609c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:48.227319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 431/860] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:53:48 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:50.363383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e468917-67f3-4dfd-88d2-1f878dba84da None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:50.363883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e468917-67f3-4dfd-88d2-1f878dba84da None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:50.363883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e468917-67f3-4dfd-88d2-1f878dba84da None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:50.365213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 430/861] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:50.370363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:50.370758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:50.370940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:50.389125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:50.390321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:50.453724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 432/862] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:50.719290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e468917-67f3-4dfd-88d2-1f878dba84da None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:50.780989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:50.818706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e468917-67f3-4dfd-88d2-1f878dba84da None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:50.851825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85937f8d-5163-4566-940f-934368afa220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:50.852456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937f8d-5163-4566-940f-934368afa220 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:50.852733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937f8d-5163-4566-940f-934368afa220 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:50.853001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937f8d-5163-4566-940f-934368afa220 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:50.854093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85937f8d-5163-4566-940f-934368afa220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:50.855519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85937f8d-5163-4566-940f-934368afa220 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:50.857068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 431/863] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:50.863060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:50.958074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a66c-a848-4363-a92b-01aa38ca3279 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:50.965625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:50.993150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3399b3-2b1f-4dad-ade0-6f1107a40038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:50.993688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3399b3-2b1f-4dad-ade0-6f1107a40038 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:50.993963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3399b3-2b1f-4dad-ade0-6f1107a40038 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:50.994231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3399b3-2b1f-4dad-ade0-6f1107a40038 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:50.994873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3399b3-2b1f-4dad-ade0-6f1107a40038 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:50.996863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3399b3-2b1f-4dad-ade0-6f1107a40038 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:51.017404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 433/864] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:53:50 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:53:53.147054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1225e7-81b0-43fd-a2d2-7665a2983a6a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.147510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1225e7-81b0-43fd-a2d2-7665a2983a6a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.147600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1225e7-81b0-43fd-a2d2-7665a2983a6a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.148948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 432/865] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:53.154736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.155135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.155287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.173548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:53.174736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:53.239768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 434/866] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:53:53.509564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1225e7-81b0-43fd-a2d2-7665a2983a6a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:53.607069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1225e7-81b0-43fd-a2d2-7665a2983a6a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:53.635007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:53.640506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:53.641112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.641383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.641647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.651235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:53.655961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:53.657071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:53:53.658104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 433/867] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:53.663130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:53.752013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:53.761190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd133-dbed-4d9b-bf9d-2d46a233b1d1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:53.794083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:53.794673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.794947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.795215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.795860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:53.796156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:53.797529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:53.805266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 435/868] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:53.811525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:53.904741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f013d-99c9-4b91-83c2-8ab85b1ec0b0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:53.937298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:53.937899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:53.938172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:53.938438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] PATH_INFO: `/v3/users/f098185246404f05bdb5e84d6d409a6f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:53.950837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] RBAC: Authorizing `identity:get_user(user_id=f098185246404f05bdb5e84d6d409a6f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:53.952247 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:53.953812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 434/869] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:53 2022] GET /identity/v3/users/f098185246404f05bdb5e84d6d409a6f => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:53.959173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:54.054762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7d1c-7496-4057-b4df-ebf5badba736 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:54.086405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75b8ee-e7b0-4655-a30a-a1f6ed343d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:54.087007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75b8ee-e7b0-4655-a30a-a1f6ed343d1c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:54.087278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75b8ee-e7b0-4655-a30a-a1f6ed343d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:54.087545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75b8ee-e7b0-4655-a30a-a1f6ed343d1c None admin] PATH_INFO: `/v3/projects/484d6ad926554b2dbc9b828aeeab5347` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:54.088647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75b8ee-e7b0-4655-a30a-a1f6ed343d1c None admin] RBAC: Authorizing `identity:get_project(project_id=484d6ad926554b2dbc9b828aeeab5347)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:54.090077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75b8ee-e7b0-4655-a30a-a1f6ed343d1c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:54.091658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 436/870] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:53:53 2022] GET /identity/v3/projects/484d6ad926554b2dbc9b828aeeab5347 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:54.097543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:54.145603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:54.192324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34c418-4131-4137-aef8-6f9b1b085d30 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:54.224439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d0167-a22c-4fb1-bf79-34278de5f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:54.225074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d0167-a22c-4fb1-bf79-34278de5f5ed None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:54.225349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d0167-a22c-4fb1-bf79-34278de5f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:54.225614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d0167-a22c-4fb1-bf79-34278de5f5ed None admin] PATH_INFO: `/v3/projects/484d6ad926554b2dbc9b828aeeab5347/users/f098185246404f05bdb5e84d6d409a6f/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:54.227453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d0167-a22c-4fb1-bf79-34278de5f5ed None admin] RBAC: Authorizing `identity:create_grant(project_id=484d6ad926554b2dbc9b828aeeab5347, user_id=f098185246404f05bdb5e84d6d409a6f, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:54.228888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d0167-a22c-4fb1-bf79-34278de5f5ed None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:54.241534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 435/871] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:53:54 2022] PUT /identity/v3/projects/484d6ad926554b2dbc9b828aeeab5347/users/f098185246404f05bdb5e84d6d409a6f/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:53:56.344599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5466-f58b-4a44-9d0d-90b2ed9ae4bc None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:56.345180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5466-f58b-4a44-9d0d-90b2ed9ae4bc None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:56.345180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5466-f58b-4a44-9d0d-90b2ed9ae4bc None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:56.346476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 437/872] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:56.351623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:56.352027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:56.352167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:56.371229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:56.372432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:53:56.436509 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 436/873] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:53:56.704301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb5466-f58b-4a44-9d0d-90b2ed9ae4bc None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:56.841757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:56.915650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb5466-f58b-4a44-9d0d-90b2ed9ae4bc None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:56.948167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:56.948888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:56.949109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:56.949376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:56.959387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:53:56.964269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:53:56.965450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:53:56.966346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 438/874] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:53:56.971507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.011944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.067594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddf3f3-7a8c-4e59-91df-427514c3f860 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.101841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.102446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.102723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.102998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.103657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:57.103955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.105889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.114028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 437/875] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:57.119801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.197597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.216235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2314d-8d47-442b-b379-8e9c9bfdb958 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.248841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.249472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.249748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.250017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] PATH_INFO: `/v3/users/f098185246404f05bdb5e84d6d409a6f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.251109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] RBAC: Authorizing `identity:get_user(user_id=f098185246404f05bdb5e84d6d409a6f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.252537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.254088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 439/876] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:53:57 2022] GET /identity/v3/users/f098185246404f05bdb5e84d6d409a6f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:57.259694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.355981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538f29-0b8a-46c4-a930-e3364fb1a028 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.357494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.390046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c1666-2264-420b-8045-849a371a7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.390632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c1666-2264-420b-8045-849a371a7fde None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.390910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c1666-2264-420b-8045-849a371a7fde None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.391179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c1666-2264-420b-8045-849a371a7fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.460259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c1666-2264-420b-8045-849a371a7fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.461723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c1666-2264-420b-8045-849a371a7fde None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.555593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 438/877] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:53:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:53:57.562044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.657815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71f040-cae6-4551-8b7e-9f9acca52a9d None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.688923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4fec1-60bd-42c5-942b-97902fc5d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.689528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4fec1-60bd-42c5-942b-97902fc5d5ec None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.689801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4fec1-60bd-42c5-942b-97902fc5d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.690069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4fec1-60bd-42c5-942b-97902fc5d5ec None admin] PATH_INFO: `/v3/projects/484d6ad926554b2dbc9b828aeeab5347` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.691139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4fec1-60bd-42c5-942b-97902fc5d5ec None admin] RBAC: Authorizing `identity:get_project(project_id=484d6ad926554b2dbc9b828aeeab5347)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.692560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4fec1-60bd-42c5-942b-97902fc5d5ec None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.694111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 440/878] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:53:57 2022] GET /identity/v3/projects/484d6ad926554b2dbc9b828aeeab5347 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:57.700488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c1666-2264-420b-8045-849a371a7fde None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:53:57.702584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:53:57.794402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c1666-2264-420b-8045-849a371a7fde None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:53:57.826778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:53:57.827358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:57.827631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:57.827895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:57.828627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=484d6ad926554b2dbc9b828aeeab5347, user.id=f098185246404f05bdb5e84d6d409a6f) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:53:57.828925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:53:57.830318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46d658-c39c-426e-9495-e9bae92d36d0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:53:57.835789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 439/879] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:53:57 2022] GET /identity/v3/role_assignments?user.id=f098185246404f05bdb5e84d6d409a6f&scope.project.id=484d6ad926554b2dbc9b828aeeab5347&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:53:59.943509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8f43-570a-4b55-93af-41e732eb2015 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:59.944073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8f43-570a-4b55-93af-41e732eb2015 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:59.944073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8f43-570a-4b55-93af-41e732eb2015 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:59.945374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 441/880] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:53:59.951159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85fbc2-709e-4110-ab9f-56ca69dfcecd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:53:59.951533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85fbc2-709e-4110-ab9f-56ca69dfcecd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:53:59.951703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85fbc2-709e-4110-ab9f-56ca69dfcecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:53:59.970196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2e85fbc2-709e-4110-ab9f-56ca69dfcecd None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:53:59.971358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2e85fbc2-709e-4110-ab9f-56ca69dfcecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:54:00.027595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:00.034928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 440/881] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:53:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:54:00.300730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8f43-570a-4b55-93af-41e732eb2015 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:00.320128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:00.402510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8f43-570a-4b55-93af-41e732eb2015 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:00.435016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf76485-5cfe-42e5-af15-98ae92ea026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:00.435610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76485-5cfe-42e5-af15-98ae92ea026d None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:00.435887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76485-5cfe-42e5-af15-98ae92ea026d None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:00.436155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf76485-5cfe-42e5-af15-98ae92ea026d None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:00.436845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf76485-5cfe-42e5-af15-98ae92ea026d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:00.438184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf76485-5cfe-42e5-af15-98ae92ea026d None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:00.453556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 442/882] 10.222.0.49 () {60 vars in 1138 bytes} [Wed Oct 26 10:54:00 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:54:02.596318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ec90-71ae-40fc-af91-cec2130f53c8 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:02.596895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ec90-71ae-40fc-af91-cec2130f53c8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:02.596895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ec90-71ae-40fc-af91-cec2130f53c8 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:02.598227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 441/883] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:54:02.603437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:02.603821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:02.603992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:02.622623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:54:02.623793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:54:02.687930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 443/884] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:54:02.958028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ec90-71ae-40fc-af91-cec2130f53c8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:03.056635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ec90-71ae-40fc-af91-cec2130f53c8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:03.089046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0099ca-7fa0-4080-bb50-edb9658843e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:03.089722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0099ca-7fa0-4080-bb50-edb9658843e8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:03.090020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0099ca-7fa0-4080-bb50-edb9658843e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:03.090302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0099ca-7fa0-4080-bb50-edb9658843e8 None admin] PATH_INFO: `/v3/domains/67585a2a92ad4b4f9a1f0847e864d7db` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:03.102987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0099ca-7fa0-4080-bb50-edb9658843e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=67585a2a92ad4b4f9a1f0847e864d7db)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:03.104445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0099ca-7fa0-4080-bb50-edb9658843e8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:03.106569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 442/885] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Oct 26 10:54:02 2022] GET /identity/v3/domains/67585a2a92ad4b4f9a1f0847e864d7db => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:03.112559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:03.122886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:03.207406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef353a-bc0d-4cea-8689-5d68f848b1a4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:03.240473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925b11e-cbd9-45f9-a259-3beaab9f99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:03.241003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925b11e-cbd9-45f9-a259-3beaab9f99b4 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:03.241275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925b11e-cbd9-45f9-a259-3beaab9f99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:03.241542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925b11e-cbd9-45f9-a259-3beaab9f99b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:03.242166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925b11e-cbd9-45f9-a259-3beaab9f99b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:03.243570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925b11e-cbd9-45f9-a259-3beaab9f99b4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:03.269090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 444/886] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:54:03 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:54:05.413178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ecc75-fc74-4a96-a10b-646385ba05d3 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:05.413691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ecc75-fc74-4a96-a10b-646385ba05d3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:05.413691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ecc75-fc74-4a96-a10b-646385ba05d3 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:05.414978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 443/887] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:54:05.420623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:05.421057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:05.421200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:05.438875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:54:05.440031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:54:05.499079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:05.510408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 445/888] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:54:05.781293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ecc75-fc74-4a96-a10b-646385ba05d3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:05.837916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:05.880774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ecc75-fc74-4a96-a10b-646385ba05d3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:05.913634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c63f4-9c13-463a-a41f-5c1f7221dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:05.914248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c63f4-9c13-463a-a41f-5c1f7221dd2c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:05.914525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c63f4-9c13-463a-a41f-5c1f7221dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:05.914797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c63f4-9c13-463a-a41f-5c1f7221dd2c None admin] PATH_INFO: `/v3/domains/67585a2a92ad4b4f9a1f0847e864d7db` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:05.915895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c63f4-9c13-463a-a41f-5c1f7221dd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=67585a2a92ad4b4f9a1f0847e864d7db)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:05.917358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c63f4-9c13-463a-a41f-5c1f7221dd2c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:05.918882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 444/889] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Oct 26 10:54:05 2022] GET /identity/v3/domains/67585a2a92ad4b4f9a1f0847e864d7db => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:05.924443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:06.019249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe43c-0cdf-4187-b265-913ebbfd7d54 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:06.052367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b177c6b-c391-44a1-ad59-38dbf8d0f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:06.052911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b177c6b-c391-44a1-ad59-38dbf8d0f7a6 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:06.053186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b177c6b-c391-44a1-ad59-38dbf8d0f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:06.053455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b177c6b-c391-44a1-ad59-38dbf8d0f7a6 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:06.054101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b177c6b-c391-44a1-ad59-38dbf8d0f7a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:06.055507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b177c6b-c391-44a1-ad59-38dbf8d0f7a6 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:06.076004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 446/890] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:54:05 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:54:08.200129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae53470-9253-4b6d-894a-7a7b2c95ebc6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:08.200706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae53470-9253-4b6d-894a-7a7b2c95ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:08.200706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae53470-9253-4b6d-894a-7a7b2c95ebc6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:08.202038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 445/891] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:54:08.207177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:08.207605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:08.207719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:08.225803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:54:08.226955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:54:08.267020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:08.291841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 447/892] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:54:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:54:08.555530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae53470-9253-4b6d-894a-7a7b2c95ebc6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:08.653932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae53470-9253-4b6d-894a-7a7b2c95ebc6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:08.675945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:08.686925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:08.687538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:08.687815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:08.688084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:08.697781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:54:08.703115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:54:08.704251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:54:08.705369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 446/893] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:54:08.710170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:08.804281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb030c3c-80b3-437e-bb5c-66189aa75f96 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:08.838089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:08.838677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:08.838950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:08.839788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:08.840458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:54:08.840759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:08.842083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:08.849730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 448/894] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:54:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:08.855947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:08.951178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130d31-d021-4f00-bc6c-3a23d5bff32e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:08.984142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:08.984770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:08.985296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:08.985578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] PATH_INFO: `/v3/users/0de698c394b74f679e6f60e15529d7fb` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:08.998602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] RBAC: Authorizing `identity:get_user(user_id=0de698c394b74f679e6f60e15529d7fb)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:09.000017 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:09.001587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 447/895] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:54:08 2022] GET /identity/v3/users/0de698c394b74f679e6f60e15529d7fb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:09.007135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:09.045493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:09.103608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb1ff-5ff3-4ba8-a70f-b24b8ff46915 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:09.136693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55caa21-ab97-48ee-9521-f764ae906365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:09.137305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55caa21-ab97-48ee-9521-f764ae906365 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:09.137576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55caa21-ab97-48ee-9521-f764ae906365 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:09.137841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55caa21-ab97-48ee-9521-f764ae906365 None admin] PATH_INFO: `/v3/projects/4a88b3401684421e888532ba1ae96be2` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:09.138923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55caa21-ab97-48ee-9521-f764ae906365 None admin] RBAC: Authorizing `identity:get_project(project_id=4a88b3401684421e888532ba1ae96be2)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:09.140312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55caa21-ab97-48ee-9521-f764ae906365 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:09.141917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 449/896] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:54:09 2022] GET /identity/v3/projects/4a88b3401684421e888532ba1ae96be2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:09.147797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:09.189496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:09.242862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a42a7-b4b8-4676-b714-d18fea65e874 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:09.274166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87eccf-e912-4e8d-a555-3ff3b5246568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:09.274797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87eccf-e912-4e8d-a555-3ff3b5246568 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:09.275069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87eccf-e912-4e8d-a555-3ff3b5246568 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:09.275337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87eccf-e912-4e8d-a555-3ff3b5246568 None admin] PATH_INFO: `/v3/projects/4a88b3401684421e888532ba1ae96be2/users/0de698c394b74f679e6f60e15529d7fb/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:09.277732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87eccf-e912-4e8d-a555-3ff3b5246568 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a88b3401684421e888532ba1ae96be2, user_id=0de698c394b74f679e6f60e15529d7fb, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:09.279128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87eccf-e912-4e8d-a555-3ff3b5246568 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:09.291209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 448/897] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:54:09 2022] PUT /identity/v3/projects/4a88b3401684421e888532ba1ae96be2/users/0de698c394b74f679e6f60e15529d7fb/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:54:11.410278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74385b-aec6-4a6d-89f1-cf8a08fac7f2 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:11.410821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74385b-aec6-4a6d-89f1-cf8a08fac7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:11.410821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74385b-aec6-4a6d-89f1-cf8a08fac7f2 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:11.412035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 450/898] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:54:11.417882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:11.418321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:11.418419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:11.436154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:54:11.437376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:54:11.502111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 449/899] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:54:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:54:11.769998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74385b-aec6-4a6d-89f1-cf8a08fac7f2 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:11.867020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74385b-aec6-4a6d-89f1-cf8a08fac7f2 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:11.873608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:11.899813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:11.900444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:11.900718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:11.900984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:11.911101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:54:11.915822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:54:11.917037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:54:11.918119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 451/900] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:54:11.922776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:11.952185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:12.018771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb59c02-df80-4557-94b1-476c7719ee23 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:12.050852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:12.051384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:12.051661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:12.051937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:12.052615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:54:12.052913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:12.054252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:12.061957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 450/901] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:12.067690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:12.167257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1814c20-682b-48d9-8ada-af00b10dd235 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:12.200567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:12.201189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:12.201465 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:12.201736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] PATH_INFO: `/v3/users/0de698c394b74f679e6f60e15529d7fb` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:12.202843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] RBAC: Authorizing `identity:get_user(user_id=0de698c394b74f679e6f60e15529d7fb)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:12.204255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:12.205832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 452/902] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Oct 26 10:54:12 2022] GET /identity/v3/users/0de698c394b74f679e6f60e15529d7fb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:12.211581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:12.300843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:12.308480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb7b5-fd06-4f8b-9216-b5c1ad0a43fc None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:12.340566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:12.341147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:12.341419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:12.341683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:12.405195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:12.406603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:12.491941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:12.500008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 451/903] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:54:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:54:12.505804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:12.538703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:12.602177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f031fa4-5dbb-4096-aafd-755b1c06501b None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:12.635584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037df9-47a4-4869-a9c7-0eca66b43698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:12.636223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037df9-47a4-4869-a9c7-0eca66b43698 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:12.636526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037df9-47a4-4869-a9c7-0eca66b43698 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:12.636799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037df9-47a4-4869-a9c7-0eca66b43698 None admin] PATH_INFO: `/v3/projects/4a88b3401684421e888532ba1ae96be2` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:12.637895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037df9-47a4-4869-a9c7-0eca66b43698 None admin] RBAC: Authorizing `identity:get_project(project_id=4a88b3401684421e888532ba1ae96be2)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:12.639294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037df9-47a4-4869-a9c7-0eca66b43698 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:12.640897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 453/904] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Oct 26 10:54:12 2022] GET /identity/v3/projects/4a88b3401684421e888532ba1ae96be2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:12.646848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:54:12.741797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bce3b-324e-4b4d-b97f-e78feb4bc92d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:54:12.775899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:54:12.776533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:54:12.776814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:54:12.777086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:54:12.777807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=4a88b3401684421e888532ba1ae96be2, user.id=0de698c394b74f679e6f60e15529d7fb) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:54:12.778111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:54:12.779532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c747b0e-4c0a-4206-80e5-3d099188753c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:54:12.785525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 452/905] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:54:12 2022] GET /identity/v3/role_assignments?user.id=0de698c394b74f679e6f60e15529d7fb&scope.project.id=4a88b3401684421e888532ba1ae96be2&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:54:22.631585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=49 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:54:22.782572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=71 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:07.914685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53589-3635-4f5e-a0b9-3c7a680c7b11 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:07.915315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53589-3635-4f5e-a0b9-3c7a680c7b11 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:07.915315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53589-3635-4f5e-a0b9-3c7a680c7b11 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:07.917154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 454/906] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:07.923913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:07.924501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:07.924723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:07.946360 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:07.948222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:08.035884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 453/907] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 26 10:55:08.356059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53589-3635-4f5e-a0b9-3c7a680c7b11 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:08.478550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53589-3635-4f5e-a0b9-3c7a680c7b11 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:08.517357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:08.518027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:08.518351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:08.518668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:08.533314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:08.534889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:08.551084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:08.552131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:08.553131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:08.553131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:08.553131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:08.553131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 455/908] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:55:08.559634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:08.682390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a2d4b-3634-4b23-9ec9-54eeda705a46 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:08.718742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:08.725294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:08.726173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:08.726392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:08.726655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:08.727318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:08.727710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:08.729627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baac11-30cc-4935-afbc-cbaa1f34c082 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:08.745549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 454/909] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:08.751006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:08.811751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:08.870081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a094-4aee-4f39-aeab-604b39ed4b04 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:08.913992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66222ebb-d474-48d4-bf7d-a88b3df39de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:08.914874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66222ebb-d474-48d4-bf7d-a88b3df39de3 None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:08.915502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66222ebb-d474-48d4-bf7d-a88b3df39de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:08.915502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66222ebb-d474-48d4-bf7d-a88b3df39de3 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:08.916058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66222ebb-d474-48d4-bf7d-a88b3df39de3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:08.917692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66222ebb-d474-48d4-bf7d-a88b3df39de3 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:08.956637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 456/910] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Oct 26 10:55:08 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:55:11.210904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b13c29-5697-4e0d-b471-808cb3b384cf None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:11.210904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b13c29-5697-4e0d-b471-808cb3b384cf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:11.210904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b13c29-5697-4e0d-b471-808cb3b384cf None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:11.210904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 455/911] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:11.216673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:11.218220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:11.218220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:11.238321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:11.239703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:11.318029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 457/912] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:11.600195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b13c29-5697-4e0d-b471-808cb3b384cf None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:11.718949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b13c29-5697-4e0d-b471-808cb3b384cf None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:11.760096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:11.760751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:11.761020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:11.761312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:11.775081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:55:11.779846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:11.781105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:11.782506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 456/913] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:55:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:11.787233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:11.838903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:11.915031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f1d8-1b1a-4230-8eb8-ccf06309e75c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:11.955285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:11.955897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:11.956185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:11.956734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:11.957400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:11.957700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:11.959044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:11.968239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 458/914] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:55:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:55:11.973964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:12.028861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:12.089014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954d385-d14e-460a-849c-2f1478f909a2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:12.131365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:12.132060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:12.132354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:12.132628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:12.143417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:12.144907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:12.161190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:12.162260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:12.163503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:12.163503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:12.163503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:12.163503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 457/915] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:12.168715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:12.272207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:12.276174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c5cf-5157-487f-ac9b-bb5d71bb5e74 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:12.320489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:12.321095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:12.321430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:12.321702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:12.322354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:12.322688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:12.324162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:12.336429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 459/916] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:12.342617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:12.447809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214294-132a-4d7d-b36b-15ab19e0b6d4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:12.449394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:12.483541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:12.484663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:12.484663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:12.484834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:12.492436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:12.493885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:55:12.504868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:12.505843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:12.512680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 458/917] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:12.513324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:12.620698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891150c-b663-4457-a420-ceb9595a3dc4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:12.660413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:12.661231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:12.661478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:12.661836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:12.662640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:12.662946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:12.665396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:12.684944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 460/918] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Oct 26 10:55:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:12.690756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:12.824521 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14922-57cf-4642-b1df-18be69f98722 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:12.863640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:12.864268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:12.864575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:12.864847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:12.878951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:12.880492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:12.895167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:12.896455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:12.897429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:12.897429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:12.897429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:12.897429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 459/919] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:12.903023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:12.924307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:13.055632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969faf-1c30-4f99-a5c5-2293eae41e13 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:13.107431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:13.108101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:13.108393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:13.108717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:13.109363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:13.109677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:13.111278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:13.128384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 461/920] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:13.135758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:13.162971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:13.282411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb901f1-dece-457d-923d-15aee3b91860 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:13.323266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:13.324193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:13.324917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:13.325632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:13.334877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:13.336726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:55:13.350731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:13.352135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:13.353122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 460/921] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:13.360169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:13.457799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:13.481636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34662-6050-47a2-8d6a-22241413a9c9 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:13.517034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:13.517688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:13.517974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:13.518248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:13.519886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:13.519886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:13.520813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d45b9e-f84e-4b84-9668-7ea1bb742b41 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:13.534107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 462/922] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:13.540575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:13.627389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:13.657960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f0e95-fdbb-4333-bc47-cbe0df2454ec None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:13.699406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210db30-1d72-488b-aeeb-9cf5014d1d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:13.700158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210db30-1d72-488b-aeeb-9cf5014d1d2b None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:13.700466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210db30-1d72-488b-aeeb-9cf5014d1d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:13.700778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210db30-1d72-488b-aeeb-9cf5014d1d2b None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/b273370ae8bd45098d44997b5b2c6a32/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:13.722726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210db30-1d72-488b-aeeb-9cf5014d1d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=b273370ae8bd45098d44997b5b2c6a32, role_id=b4f5cf45f5ee42b1b083e1222f0f8d9d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:13.724362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210db30-1d72-488b-aeeb-9cf5014d1d2b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:13.744305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 461/923] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:55:13 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/b273370ae8bd45098d44997b5b2c6a32/roles/b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 10:55:16.003109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c860-cd42-443e-9c17-4ae5cf3e526d None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:16.003644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c860-cd42-443e-9c17-4ae5cf3e526d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:16.003644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c860-cd42-443e-9c17-4ae5cf3e526d None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:16.005024 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 463/924] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:16.010320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:16.010745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:16.010866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:16.029492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:16.030726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:16.111944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 462/925] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:16.381731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c860-cd42-443e-9c17-4ae5cf3e526d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:16.491260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c860-cd42-443e-9c17-4ae5cf3e526d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:16.528529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:16.529164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:16.529441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:16.529749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:16.537184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:16.541557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:55:16.546780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:16.548141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:16.549513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 464/926] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Oct 26 10:55:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:16.554451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:16.613678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:16.663341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b6295-fdb5-4032-ad5e-79d2c50a7bad None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:16.701883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:16.702475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:16.702753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:16.703025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:16.703684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:16.703983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:16.705394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:16.713507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 463/927] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Oct 26 10:55:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:16.719572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:16.832178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf224a-8d9d-4440-917c-5c5baf71b4f7 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:16.866295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:16.866909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:16.867187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:16.867448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:16.879395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:16.880958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:16.898401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:16.899796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:16.901194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:16.901194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:16.901194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:16.901194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 465/928] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:16.905933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:17.013484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe16c2-964b-4928-82e7-378e2c32c8f8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:17.030383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:17.048907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:17.050996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:17.051319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:17.051602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:17.052260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:17.052597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:17.053962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:17.066717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 464/929] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:17.072975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:17.128498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:17.182240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5048e2-a7ba-492d-8505-17b80e56ec16 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:17.217546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:17.218227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:17.218532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:17.218826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:17.227139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:17.229211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:55:17.241018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:17.246430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:17.247534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 466/930] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:17.248531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:17.361558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c525f70-eebf-45a9-838d-37c17d1d1b7b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:17.400838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:17.401460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:17.401806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:17.402070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:17.402871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:17.403174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:17.404661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:17.424005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 465/931] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Oct 26 10:55:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:17.429933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:17.542333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e119-b7d2-4c58-b707-afc17f46ef24 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:17.553436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:17.580165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:17.580808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:17.581071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:17.581337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:17.654600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:17.656140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:17.768311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 467/932] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:55:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 26 10:55:17.774134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:17.812846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:17.885864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038aec-1ce1-4fc2-b563-fb22ab27af85 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:17.919867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:17.920451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:17.920730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:17.920999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:17.931138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:17.932601 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:17.949003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:17.950182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:17.951122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:17.951122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:17.951122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:17.951122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 466/933] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:55:17.955984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:17.969708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:18.061912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f8df8-3248-45a8-bc73-3d26fb3fee7a None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:18.106064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:18.106673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:18.106946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:18.107212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:18.107864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:18.108148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:18.109544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:18.121825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 468/934] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:18.127998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:18.219881 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:18.234681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689eefb-415f-4c50-8c93-e83f95f1b14c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:18.271204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:18.271999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:18.272277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:18.272719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:18.279481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:18.281096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:55:18.296691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:18.297806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:18.298845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 467/935] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:18.303611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:18.378596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:18.412424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b9af-e9ce-4b36-b07c-93ddda164052 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:18.451047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:18.451657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:18.452589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:18.452589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:18.452893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:18.453211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:18.454598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b052c-cb05-44f6-b7ce-4e40aa37fb1a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:18.468400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 469/936] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:18.474863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:18.585690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce0591-be98-41d1-ba86-190b307b3851 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:18.621527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:18.622131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:18.622404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:18.622671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:18.623383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] RBAC: Adding query filter params (role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=b273370ae8bd45098d44997b5b2c6a32) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:18.623685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:18.625142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0720-70db-492b-aacf-483a2d9d045c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:18.631506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 468/937] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:55:18 2022] GET /identity/v3/role_assignments?user.id=b273370ae8bd45098d44997b5b2c6a32&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=b4f5cf45f5ee42b1b083e1222f0f8d9d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:55:20.879689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6682cb-0c0c-452d-8282-59bdd1f54051 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:20.880229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6682cb-0c0c-452d-8282-59bdd1f54051 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:20.880229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6682cb-0c0c-452d-8282-59bdd1f54051 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:20.882030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 470/938] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:20.886970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:20.887440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:20.887522 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:20.905758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:20.907025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:20.910084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:20.977927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 469/939] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:21.271435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6682cb-0c0c-452d-8282-59bdd1f54051 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:21.383109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6682cb-0c0c-452d-8282-59bdd1f54051 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:21.415968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:21.422778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:21.423504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:21.423809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:21.424101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:21.435655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:55:21.440437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:21.441432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:21.442314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 471/940] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:21.448257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:21.551801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e9ea-6a90-4833-879c-383ea45b5f30 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:21.587724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:21.588352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:21.588635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:21.588901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:21.589550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:21.589849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:21.591200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:21.600337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 470/941] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:55:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:21.606870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:21.712881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52710-7044-4b0d-b8e0-7e090543ea60 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:21.751512 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:21.752231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:21.752541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:21.752820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:21.766257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:21.767707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:21.794958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:21.796125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:21.797100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:21.797100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:21.797100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:21.797100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 472/942] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:55:21.803015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:21.806605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:21.915677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a72df-5742-4453-8208-60db8b0deda4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:21.951949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:21.952614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:21.952902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:21.953209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:21.953950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:21.954271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:21.956000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:21.969183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 471/943] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:21.975089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:22.022110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:22.084117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ce83-0db9-4244-910a-33d5c62125bf None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:22.120724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:22.121356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:22.121634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:22.121912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:22.130203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:22.131809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:55:22.144167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:22.145324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:22.146435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 473/944] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:22.151961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:22.218751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:22.259617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc31d6-5c9a-45ee-8c55-23906661a8d5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:22.298304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:22.298939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:22.299214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:22.299485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:22.300260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:22.300671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:22.302226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:22.321325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 472/945] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Oct 26 10:55:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:55:22.327108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:22.433401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b1b9c-b3bb-41d5-b99c-bff8f9a24f88 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:22.434836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:22.468010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:22.468669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:22.468950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:22.469222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:22.480687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:22.482160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:22.498852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:22.500023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:22.501047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:22.501047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:22.501047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:22.501047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 474/946] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:22.506427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:22.626465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b3f26-6179-4dd3-b3eb-f35e63df8ca6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:22.647826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:22.663217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:22.663858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:22.664139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:22.664452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:22.665670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:22.665976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:22.667357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:22.679368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 473/947] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:55:22.685547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:22.803314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6bdda-3989-4458-b65c-499bb02e02c2 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:22.841431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:22.842173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:22.842479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:22.842751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:22.849714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:22.851148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:55:22.864786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:22.866045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:22.867400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 475/948] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:55:22.872311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:22.977114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c577-9926-48a1-b4e1-6b51cf4810e5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:23.018404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:23.019042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:23.019324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:23.019596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:23.020287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:23.020636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:23.022044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d21fb1-247b-4706-bbed-a2de86d595e9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:23.036531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 474/949] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:23.042592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:23.059926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:23.160085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5a0c-cf7f-46d3-8345-621ae85e4f2c None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:23.199143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b348ad7-f574-4b2c-9505-00f078e80719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:23.199740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348ad7-f574-4b2c-9505-00f078e80719 None admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:23.200017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348ad7-f574-4b2c-9505-00f078e80719 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:23.200295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348ad7-f574-4b2c-9505-00f078e80719 None admin] PATH_INFO: `/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/b273370ae8bd45098d44997b5b2c6a32/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:23.202256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348ad7-f574-4b2c-9505-00f078e80719 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140375e7b4649c7b81de93d8e3b34fe, user_id=b273370ae8bd45098d44997b5b2c6a32, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:23.203668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348ad7-f574-4b2c-9505-00f078e80719 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:23.217811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 476/950] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Oct 26 10:55:23 2022] PUT /identity/v3/projects/9140375e7b4649c7b81de93d8e3b34fe/users/b273370ae8bd45098d44997b5b2c6a32/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 10:55:25.434290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee1fc4-f6ac-4bd1-a4ce-70681f3e59de None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:25.434810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee1fc4-f6ac-4bd1-a4ce-70681f3e59de None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:25.434810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee1fc4-f6ac-4bd1-a4ce-70681f3e59de None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:25.436080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 475/951] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:25.441555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:25.442011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:25.442179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:25.461496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:25.463172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:25.534951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 477/952] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:25.814653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee1fc4-f6ac-4bd1-a4ce-70681f3e59de None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:25.859864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:25.925030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee1fc4-f6ac-4bd1-a4ce-70681f3e59de None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:25.962944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:25.963578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:25.963856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:25.964128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:25.973993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 26 10:55:25.978827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:25.979940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:25.981304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 476/953] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Oct 26 10:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 26 10:55:25.986188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:25.989342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:26.105262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930824a-84ad-49a8-a63c-107a77911c72 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:26.144018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:26.144832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:26.145119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:26.145393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:26.146301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:26.146600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:26.148166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:26.158733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 478/954] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Oct 26 10:55:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:26.165405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:26.272295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:26.276357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42767f5-d3da-4496-ab97-347e47708372 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:26.313260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:26.313866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:26.314140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:26.314413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:26.325842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:26.327420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:26.343762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:26.345016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:26.345944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:26.345944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:26.345944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:26.345944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 477/955] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:26.351375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:26.420771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:26.461659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675a2c7-6508-4c94-8249-752a4a6e8990 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:26.498303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:26.498978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:26.499261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:26.499535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:26.500204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:26.500555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:26.502029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:26.515362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 479/956] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:26.521213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:26.634274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bf10-8f26-47e2-88b3-e37777ae115a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:26.668307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:26.668977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:26.669231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:26.669495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:26.677244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:26.678663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 26 10:55:26.691576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:26.692815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:26.693787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 478/957] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:26.699136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:26.812915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c94c-e574-4b5a-943e-0e23e2142cd4 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:26.839153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:26.848456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:26.849074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:26.849348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:26.849612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:26.850344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:26.850643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:26.852694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:26.872985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 480/958] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Oct 26 10:55:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:26.878934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:26.894829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:26.981227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1497ed-e144-45b8-812a-7f41a9c3a491 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:27.016816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:27.017431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:27.017707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:27.017977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:27.088177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:27.092149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:27.107400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:27.193853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 479/959] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Oct 26 10:55:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 26 10:55:27.199609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:27.301145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f397da-c17b-4330-ab6e-6a8a0f30149e None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:27.338372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:27.338993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:27.339267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:27.339534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:27.349574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:27.350968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 26 10:55:27.365679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:27.366830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 26 10:55:27.368501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 26 10:55:27.368501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 26 10:55:27.368501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:27.368501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 481/960] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:27.373085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:27.468263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f91895-34bf-4bbb-914c-0cb77cbb97db None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:27.481376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:27.502218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:27.502810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:27.503086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:27.503355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:27.503982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:27.504278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:27.505641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:27.516917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 480/961] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Oct 26 10:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 10:55:27.522520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:27.556978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:27.620025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5ebe-39b9-4133-862c-30c6cc373f40 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:27.652899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:27.653508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:27.653786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:27.654058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:27.660458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:27.661878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 26 10:55:27.672810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:27.673817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: ERROR keystone.server.flask.application Oct 26 10:55:27.674861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 482/962] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Oct 26 10:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:27.679685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:27.782966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2f847-56ec-498e-b654-5898392623ff None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:27.817699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:27.818295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:27.818576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:27.818849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:27.819534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:27.819838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:27.822229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebab315-7b82-46b1-96bf-5be57261d48a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:27.834904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 481/963] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Oct 26 10:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:27.841733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:27.932344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:27.938352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290d590-56f5-46de-8fb7-5eb4205feadf None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:27.971139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:27.971725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:27.972002 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:27.972276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:27.973012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] RBAC: Adding query filter params (role.id=908e0bd4dbaf48168221f4987ad7df3d, scope.project.id=9140375e7b4649c7b81de93d8e3b34fe, user.id=b273370ae8bd45098d44997b5b2c6a32) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:27.973319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:27.974737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf05eb-737c-4ea2-a779-58ebe5014893 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:27.980355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 483/964] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Oct 26 10:55:27 2022] GET /identity/v3/role_assignments?user.id=b273370ae8bd45098d44997b5b2c6a32&scope.project.id=9140375e7b4649c7b81de93d8e3b34fe&role.id=908e0bd4dbaf48168221f4987ad7df3d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:30.101324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82cfb-dd08-4f80-bf55-1abc9bef654f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:30.101755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82cfb-dd08-4f80-bf55-1abc9bef654f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:30.102416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc82cfb-dd08-4f80-bf55-1abc9bef654f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:30.103756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 482/965] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:30.108816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:30.109215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:30.109365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:30.127835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:30.129053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:30.192977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 484/966] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:30.458461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82cfb-dd08-4f80-bf55-1abc9bef654f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:30.488611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:30.556700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc82cfb-dd08-4f80-bf55-1abc9bef654f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:30.588126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:30.588756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:30.589030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:30.589293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:30.589856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:30.591261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:30.599645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:30.600862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:30.602407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 483/967] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:55:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:30.607142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:30.693106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:30.702752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4cdf7-eb4c-4626-8185-a31da2e60bd5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:30.736110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:30.736939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:30.737245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:30.737588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:30.738324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:30.738745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:30.740304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45611b-346f-4ca2-afe3-d68bdcae2cfc None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:30.746229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 485/968] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Oct 26 10:55:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:30.752283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:30.855758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:30.862033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7578847-dff1-47fe-b6e1-9af4c3582099 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:30.894246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:30.894861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:30.895131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:30.895396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:30.896012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:30.896307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:30.897671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94406-6af4-466f-938d-0a2f608bf312 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:30.902375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 484/969] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Oct 26 10:55:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:33.014344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb90a2-6036-46a1-b96c-21507b7e05f1 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:33.014879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb90a2-6036-46a1-b96c-21507b7e05f1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:33.014879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb90a2-6036-46a1-b96c-21507b7e05f1 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:33.016212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 486/970] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:33.021286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06240f-8da2-434e-ae91-d7c7956ebe0a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:33.021735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06240f-8da2-434e-ae91-d7c7956ebe0a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:33.021828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06240f-8da2-434e-ae91-d7c7956ebe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:33.040131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bd06240f-8da2-434e-ae91-d7c7956ebe0a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:33.041350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bd06240f-8da2-434e-ae91-d7c7956ebe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:33.105955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 485/971] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:33.371236 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb90a2-6036-46a1-b96c-21507b7e05f1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:33.469340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb90a2-6036-46a1-b96c-21507b7e05f1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:33.502683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f286ec-e31d-426b-a69a-2ec8c7f3b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:33.503269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f286ec-e31d-426b-a69a-2ec8c7f3b48a None admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:33.503547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f286ec-e31d-426b-a69a-2ec8c7f3b48a None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:33.503815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f286ec-e31d-426b-a69a-2ec8c7f3b48a None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:33.504471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f286ec-e31d-426b-a69a-2ec8c7f3b48a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:33.505817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f286ec-e31d-426b-a69a-2ec8c7f3b48a None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:33.520212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 487/972] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Oct 26 10:55:33 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:55:35.626328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655c7d3-1972-4181-9870-4131b85524a2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:35.626915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655c7d3-1972-4181-9870-4131b85524a2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:35.626915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655c7d3-1972-4181-9870-4131b85524a2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:35.628238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 486/973] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:35.633361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:35.633785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:35.633909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:35.651982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:35.653178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:35.662065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:35.723415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 488/974] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:35.986246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655c7d3-1972-4181-9870-4131b85524a2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:36.073421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:36.083659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655c7d3-1972-4181-9870-4131b85524a2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:36.118070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:36.118689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:36.118964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:36.119231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:36.119798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:36.121176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:36.129711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:36.130979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:36.132106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 487/975] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:55:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:36.137336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:36.231887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19105-cafb-43ab-8401-749ea4193074 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:36.264138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:36.264698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:36.264973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:36.265241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:36.265883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:36.266180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:36.267517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:36.272438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 489/976] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Oct 26 10:55:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:36.278559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:36.374195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31646-e6e5-4a5f-bc3c-4d3a7ff1bb53 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:36.406008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:36.406587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:36.406863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:36.407130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:36.407811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] RBAC: Adding query filter params (interface=public, service_id=27aca575cc8c4f26aa8f95bee29a541e, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:36.408111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:36.409472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827aeb9-10df-4391-8307-e67708f9cfea None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:36.414751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 488/977] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Oct 26 10:55:36 2022] GET /identity/v3/endpoints?service_id=27aca575cc8c4f26aa8f95bee29a541e&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:36.420042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:36.423629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:36.515908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc00c8-695a-4d33-a99a-7d112e5d4221 None admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:36.548227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce0efe-5fec-4d86-9a42-d46325753b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:36.548844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0efe-5fec-4d86-9a42-d46325753b0f None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:36.549118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0efe-5fec-4d86-9a42-d46325753b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:36.549385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce0efe-5fec-4d86-9a42-d46325753b0f None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:36.549972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce0efe-5fec-4d86-9a42-d46325753b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:36.551300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce0efe-5fec-4d86-9a42-d46325753b0f None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:36.557958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 490/978] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Oct 26 10:55:36 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:55:38.680565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1a34e-2005-44dc-9413-a184233b3299 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:38.681093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1a34e-2005-44dc-9413-a184233b3299 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:38.681093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1a34e-2005-44dc-9413-a184233b3299 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:38.682420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 489/979] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:55:38.687616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:38.688040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:38.688165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:38.706654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:55:38.707840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:55:38.776137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:38.784222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 491/980] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:55:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 26 10:55:39.062487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1a34e-2005-44dc-9413-a184233b3299 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:39.081832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:39.165686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1a34e-2005-44dc-9413-a184233b3299 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:39.198060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:39.198671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:39.198948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:39.199215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:39.199779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:39.201156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 26 10:55:39.209618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 26 10:55:39.210735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 26 10:55:39.211776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 490/981] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Oct 26 10:55:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 26 10:55:39.219049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:39.314312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed69e0-9c00-4e5a-904f-b523657bcac9 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:39.346974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:39.347561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:39.347836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:39.348105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] PATH_INFO: `/v3/services` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:39.348745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 10:55:39.349041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:39.350382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab855-fd26-4d7c-a685-be8daf490552 None admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:39.355325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 492/982] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Oct 26 10:55:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 10:55:39.361224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:55:39.439188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:39.457083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904e9ea-7296-4b6c-affd-7d1a44fcf5aa None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:55:39.489253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703c752-3903-4a3f-9327-81259f0dadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:55:39.489836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c752-3903-4a3f-9327-81259f0dadda None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:55:39.490114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c752-3903-4a3f-9327-81259f0dadda None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:55:39.490388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c752-3903-4a3f-9327-81259f0dadda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:55:39.491042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c752-3903-4a3f-9327-81259f0dadda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:55:39.492966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c752-3903-4a3f-9327-81259f0dadda None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:55:39.511728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 491/983] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 10:55:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 10:55:49.352621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=69 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:55:49.506939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:42.992714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94aafc-0f69-4d4a-b2b0-0100c3eb5991 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:42.992714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94aafc-0f69-4d4a-b2b0-0100c3eb5991 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:42.992714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94aafc-0f69-4d4a-b2b0-0100c3eb5991 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:42.992714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 493/984] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:42.997599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39587b5d-7dbe-4f82-b50c-49e4d7511cc6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:42.997993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39587b5d-7dbe-4f82-b50c-49e4d7511cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:42.998157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39587b5d-7dbe-4f82-b50c-49e4d7511cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:43.140000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-39587b5d-7dbe-4f82-b50c-49e4d7511cc6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:43.141762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-39587b5d-7dbe-4f82-b50c-49e4d7511cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:43.289308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 492/985] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:43.579423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79f9ed-bccd-4d08-9c73-c367fe52354e None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:43.579700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79f9ed-bccd-4d08-9c73-c367fe52354e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:43.580163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79f9ed-bccd-4d08-9c73-c367fe52354e None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:43.582253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 494/986] 10.222.0.49 () {54 vars in 964 bytes} [Wed Oct 26 10:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:43.590773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7cb24-428d-4832-9cd7-bf409837300e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:43.591070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7cb24-428d-4832-9cd7-bf409837300e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:43.591324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7cb24-428d-4832-9cd7-bf409837300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:43.686525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1aa7cb24-428d-4832-9cd7-bf409837300e None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:43.687729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1aa7cb24-428d-4832-9cd7-bf409837300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:43.710672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:43.775623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 493/987] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Oct 26 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:43.784640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79f9ed-bccd-4d08-9c73-c367fe52354e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:56:43.786393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cb79f9ed-bccd-4d08-9c73-c367fe52354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:43.903426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79f9ed-bccd-4d08-9c73-c367fe52354e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:56:43.984855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:56:43.985731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:43.986012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:43.986354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:43.987985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:44.051255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:44.121716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:56:44.123173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5feac-c10a-4b84-9510-894979b610c2 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:56:44.155887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 495/988] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:56:46.663355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0032d-1220-414f-9629-fa6e063b6ff0 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:46.663847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0032d-1220-414f-9629-fa6e063b6ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:46.663934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0032d-1220-414f-9629-fa6e063b6ff0 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:46.665258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 494/989] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:46.670566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990ba8-59f3-4495-aad7-c1356e48acb7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:46.670942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990ba8-59f3-4495-aad7-c1356e48acb7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:46.671108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990ba8-59f3-4495-aad7-c1356e48acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:46.741691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c6990ba8-59f3-4495-aad7-c1356e48acb7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:46.742909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c6990ba8-59f3-4495-aad7-c1356e48acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:46.838308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 496/990] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:47.124573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0032d-1220-414f-9629-fa6e063b6ff0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:56:47.126098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53a0032d-1220-414f-9629-fa6e063b6ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:47.228473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0032d-1220-414f-9629-fa6e063b6ff0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:56:47.297406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:47.299892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:56:47.300705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:47.301186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:47.301665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:47.303904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:47.409448 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:56:47.410810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bcaef-3be6-46fd-a466-64decfacef11 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:56:47.429259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 495/991] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:56:49.850417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1689-6301-4844-8243-60308b6a632e None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:49.850950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1689-6301-4844-8243-60308b6a632e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:49.850950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1689-6301-4844-8243-60308b6a632e None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:49.852283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 497/992] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:49.857426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf2c1-f6b8-4225-89e9-26bc48072749 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:49.857836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf2c1-f6b8-4225-89e9-26bc48072749 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:49.857975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf2c1-f6b8-4225-89e9-26bc48072749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:49.923980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-37eaf2c1-f6b8-4225-89e9-26bc48072749 None None] MFA Rules not processed for user `c6fdebe181f0489c9dc30b88531a8eda`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:49.925193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-37eaf2c1-f6b8-4225-89e9-26bc48072749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:49.977938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:50.022204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 496/993] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:50.319035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a396-ed08-40a8-98f0-120448eb41f7 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:50.319315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a396-ed08-40a8-98f0-120448eb41f7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:50.319585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a396-ed08-40a8-98f0-120448eb41f7 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:50.320968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 498/994] 10.222.0.49 () {54 vars in 964 bytes} [Wed Oct 26 10:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:50.326656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d4866-9429-4b5d-ba87-61bf9b762f83 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:50.326939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d4866-9429-4b5d-ba87-61bf9b762f83 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:50.327213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d4866-9429-4b5d-ba87-61bf9b762f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:50.401980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9b1d4866-9429-4b5d-ba87-61bf9b762f83 None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:50.403175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9b1d4866-9429-4b5d-ba87-61bf9b762f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:50.477262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 497/995] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Oct 26 10:56:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:50.486654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a396-ed08-40a8-98f0-120448eb41f7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:56:50.488171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8f84a396-ed08-40a8-98f0-120448eb41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:50.498061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:50.591210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a396-ed08-40a8-98f0-120448eb41f7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:56:50.664042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:56:50.664676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:50.664951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:50.665218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:50.666784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:50.727457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:50.773952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:56:50.775366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfa2eb-3450-48b0-84a3-741dfb5e7e5c service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:56:50.793364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 499/996] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:56:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:56:53.839679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efd755-a3b9-4d36-9fd2-d4bfe4a36607 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:53.840236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efd755-a3b9-4d36-9fd2-d4bfe4a36607 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:53.840236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efd755-a3b9-4d36-9fd2-d4bfe4a36607 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:53.841598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 498/997] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:53.846905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2283e-1341-4e12-ad9c-2aac2fe76465 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:53.847281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2283e-1341-4e12-ad9c-2aac2fe76465 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:53.847449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2283e-1341-4e12-ad9c-2aac2fe76465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:53.913468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8cb2283e-1341-4e12-ad9c-2aac2fe76465 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:53.914662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8cb2283e-1341-4e12-ad9c-2aac2fe76465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:54.008480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 500/998] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:54.293101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efd755-a3b9-4d36-9fd2-d4bfe4a36607 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:56:54.294629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d0efd755-a3b9-4d36-9fd2-d4bfe4a36607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:54.344260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:54.396876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efd755-a3b9-4d36-9fd2-d4bfe4a36607 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:56:54.468066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:56:54.468688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:54.468965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:54.469230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:54.470797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:54.564819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:54.577863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:56:54.579293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578df71f-5e85-49c8-bf50-cee9d7719ae7 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:56:54.596622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 499/999] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:56:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:56:57.398585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2258-a070-4cac-a873-a8f207316acd None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:57.399122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2258-a070-4cac-a873-a8f207316acd None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:57.399122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2258-a070-4cac-a873-a8f207316acd None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:57.400660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 501/1000] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:56:57.406290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b20a-edc9-4cbf-b562-70054aee57d7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:57.406811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b20a-edc9-4cbf-b562-70054aee57d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:57.406916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b20a-edc9-4cbf-b562-70054aee57d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:57.478927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b659b20a-edc9-4cbf-b562-70054aee57d7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:56:57.480167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b659b20a-edc9-4cbf-b562-70054aee57d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:57.580150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 500/1001] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:56:57.866613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2258-a070-4cac-a873-a8f207316acd None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:56:57.868181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-585e2258-a070-4cac-a873-a8f207316acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:57.888294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:57.970818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2258-a070-4cac-a873-a8f207316acd None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:56:58.044936 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:56:58.045464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:56:58.045739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:56:58.046006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:56:58.047585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:56:58.123653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:56:58.162908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:56:58.164314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d0e90-e33d-4f79-b8d0-e518d8bd71f9 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:56:58.181973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 502/1002] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:00.389858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3557-8412-4135-a168-4e481d90965a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:00.390387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3557-8412-4135-a168-4e481d90965a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:00.390387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3557-8412-4135-a168-4e481d90965a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:00.391804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 501/1003] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:00.397612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f060a0-4d3b-49b2-8401-cabd7010a21c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:00.398022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f060a0-4d3b-49b2-8401-cabd7010a21c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:00.398314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f060a0-4d3b-49b2-8401-cabd7010a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:00.474231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-35f060a0-4d3b-49b2-8401-cabd7010a21c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:00.475477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-35f060a0-4d3b-49b2-8401-cabd7010a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:00.573630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 503/1004] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:00.855725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c3557-8412-4135-a168-4e481d90965a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:00.857303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1d7c3557-8412-4135-a168-4e481d90965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:00.916958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:00.961506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c3557-8412-4135-a168-4e481d90965a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:01.034342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:01.034977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:01.035250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:01.035519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:01.037140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:01.149464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:01.151830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:01.153398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd484-eea0-4b09-b46b-f5b166ba0fdb service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:01.172578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 502/1005] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:03.374593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9263-f5e0-45a8-aa4f-2fe54d8c46c4 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:03.375043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9263-f5e0-45a8-aa4f-2fe54d8c46c4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:03.375121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9263-f5e0-45a8-aa4f-2fe54d8c46c4 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:03.376531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 504/1006] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:03.382487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b68e-a938-40ba-8de9-727e0e32cc6b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:03.382923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b68e-a938-40ba-8de9-727e0e32cc6b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:03.383035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b68e-a938-40ba-8de9-727e0e32cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:03.448483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-59b2b68e-a938-40ba-8de9-727e0e32cc6b None None] MFA Rules not processed for user `c6fdebe181f0489c9dc30b88531a8eda`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:03.449603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-59b2b68e-a938-40ba-8de9-727e0e32cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:03.543783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 503/1007] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:03.825693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba9263-f5e0-45a8-aa4f-2fe54d8c46c4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:03.827218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-10ba9263-f5e0-45a8-aa4f-2fe54d8c46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:03.859558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:03.932634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba9263-f5e0-45a8-aa4f-2fe54d8c46c4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:04.006940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:04.007466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:04.007745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:04.008016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:04.009649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:04.085874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:04.118541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:04.119912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7694641-0a47-4c37-b995-3b3f3977e105 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:04.137738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 505/1008] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:06.531357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742503dd-ae2d-48c0-9cdf-070904a2a32a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:06.531798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742503dd-ae2d-48c0-9cdf-070904a2a32a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:06.531892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742503dd-ae2d-48c0-9cdf-070904a2a32a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:06.533220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 504/1009] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:06.539258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d7b7-1da8-4ba9-ab3c-94171c96241a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:06.539663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d7b7-1da8-4ba9-ab3c-94171c96241a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:06.539945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d7b7-1da8-4ba9-ab3c-94171c96241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:06.607129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3d23d7b7-1da8-4ba9-ab3c-94171c96241a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:06.608357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3d23d7b7-1da8-4ba9-ab3c-94171c96241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:06.705021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 506/1010] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:06.988197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742503dd-ae2d-48c0-9cdf-070904a2a32a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:06.990279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-742503dd-ae2d-48c0-9cdf-070904a2a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:07.057614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:07.092544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742503dd-ae2d-48c0-9cdf-070904a2a32a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:07.166636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:07.167239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:07.167517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:07.167791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:07.169426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:07.281627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:07.283073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf0c89-61af-4e5f-8f30-40f1896c79b5 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:07.293016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:07.301993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 505/1011] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:09.485207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79d847-a13d-4837-8012-ac8448c8a963 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:09.485967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79d847-a13d-4837-8012-ac8448c8a963 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:09.485967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79d847-a13d-4837-8012-ac8448c8a963 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:09.487305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 507/1012] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:09.492745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22f70-160e-4eaf-be06-9e58e37d372d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:09.493183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22f70-160e-4eaf-be06-9e58e37d372d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:09.493291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22f70-160e-4eaf-be06-9e58e37d372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:09.556589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-31f22f70-160e-4eaf-be06-9e58e37d372d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:09.557764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-31f22f70-160e-4eaf-be06-9e58e37d372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:09.652304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 506/1013] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:09.939438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79d847-a13d-4837-8012-ac8448c8a963 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:09.941053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8d79d847-a13d-4837-8012-ac8448c8a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:09.980366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:10.044004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79d847-a13d-4837-8012-ac8448c8a963 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:10.118063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:10.118669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:10.118946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:10.119217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:10.120837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:10.203173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:10.228194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:10.229662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f8402-8aec-4972-993b-fd538cf3cade service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:10.247921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 508/1014] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:12.703822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f83881-8fa0-45d5-ac91-202f1d3e938f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:12.704415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f83881-8fa0-45d5-ac91-202f1d3e938f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:12.704415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f83881-8fa0-45d5-ac91-202f1d3e938f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:12.705749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 507/1015] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:12.710820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec9e3-ba9c-4c28-8d25-91842dfa84cb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:12.711233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec9e3-ba9c-4c28-8d25-91842dfa84cb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:12.711364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec9e3-ba9c-4c28-8d25-91842dfa84cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:12.778949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-543ec9e3-ba9c-4c28-8d25-91842dfa84cb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:12.780075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-543ec9e3-ba9c-4c28-8d25-91842dfa84cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:12.875648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 509/1016] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:13.157664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f83881-8fa0-45d5-ac91-202f1d3e938f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:13.159236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-93f83881-8fa0-45d5-ac91-202f1d3e938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:13.233994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:13.261944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f83881-8fa0-45d5-ac91-202f1d3e938f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:13.333992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:13.334589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:13.334868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:13.335139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:13.336750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:13.443824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:13.445211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a7c1b-370f-4da9-a7fa-efa015cff5e8 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:13.462784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 508/1017] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:17.528967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0c196-3128-4fb5-baf3-86aad69c21cb None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:17.529489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0c196-3128-4fb5-baf3-86aad69c21cb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:17.529489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0c196-3128-4fb5-baf3-86aad69c21cb None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:17.531042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 510/1018] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:17.536721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a4bf-8f33-4eb2-b736-f1a80b50898f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:17.537133 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a4bf-8f33-4eb2-b736-f1a80b50898f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:17.537262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a4bf-8f33-4eb2-b736-f1a80b50898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:17.542849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:17.604073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fea3a4bf-8f33-4eb2-b736-f1a80b50898f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:17.605349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fea3a4bf-8f33-4eb2-b736-f1a80b50898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:17.702242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 509/1019] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:17.989452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0c196-3128-4fb5-baf3-86aad69c21cb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:17.990967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-44e0c196-3128-4fb5-baf3-86aad69c21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:18.039377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:18.099279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0c196-3128-4fb5-baf3-86aad69c21cb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:18.174106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:18.174701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:18.174975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:18.175240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:18.176834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:18.271424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:18.288199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:18.289660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f9d3f-6cec-44da-963c-fee7521610c2 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:18.307947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 511/1020] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:21.096898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5ed32-8759-46f3-a98e-7b26f95882d0 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:21.097321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5ed32-8759-46f3-a98e-7b26f95882d0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:21.097985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5ed32-8759-46f3-a98e-7b26f95882d0 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:21.099310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 510/1021] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:21.104525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f81fcf-c23b-4100-9dda-1c36bb133bc7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:21.104955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f81fcf-c23b-4100-9dda-1c36bb133bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:21.105056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f81fcf-c23b-4100-9dda-1c36bb133bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:21.172311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-69f81fcf-c23b-4100-9dda-1c36bb133bc7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:21.173545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-69f81fcf-c23b-4100-9dda-1c36bb133bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:21.274891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 512/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:21.560470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5ed32-8759-46f3-a98e-7b26f95882d0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:21.562038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8db5ed32-8759-46f3-a98e-7b26f95882d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:21.649777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:21.667624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5ed32-8759-46f3-a98e-7b26f95882d0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:21.742413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:21.743051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:21.743426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:21.743612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:21.745732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:21.854208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:21.855639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99883490-e849-4f9c-8f12-70afcbcb8682 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:21.874246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 511/1023] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:25.992892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563cd3-9a69-4c49-9098-cad7e9e1c24b None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:25.993424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563cd3-9a69-4c49-9098-cad7e9e1c24b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:25.993424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563cd3-9a69-4c49-9098-cad7e9e1c24b None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:25.994763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 513/1024] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:26.000060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844871ea-f3b0-4038-b2e3-33a3a12d5562 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:26.000517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844871ea-f3b0-4038-b2e3-33a3a12d5562 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:26.000777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844871ea-f3b0-4038-b2e3-33a3a12d5562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:26.017883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:26.073391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-844871ea-f3b0-4038-b2e3-33a3a12d5562 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:26.074639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-844871ea-f3b0-4038-b2e3-33a3a12d5562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:26.170966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 512/1025] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:26.453446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563cd3-9a69-4c49-9098-cad7e9e1c24b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:26.454994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-30563cd3-9a69-4c49-9098-cad7e9e1c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:26.514777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:26.560392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563cd3-9a69-4c49-9098-cad7e9e1c24b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:26.638859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:26.639464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:26.639733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:26.639996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:26.641595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:26.750101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:26.755138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:26.757254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb3ec4-c6b8-4947-b495-ac0e73456e70 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:26.776411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 514/1026] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:31.684673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac3f06-2d1c-46ee-a7d5-6d3329e4dd5f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:31.685201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac3f06-2d1c-46ee-a7d5-6d3329e4dd5f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:31.685201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac3f06-2d1c-46ee-a7d5-6d3329e4dd5f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:31.686833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 513/1027] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 10:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:31.692552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef2f3-55a4-4dd7-b650-36d48cb20edd None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:31.693021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef2f3-55a4-4dd7-b650-36d48cb20edd None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:31.693113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef2f3-55a4-4dd7-b650-36d48cb20edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:31.794437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7ffef2f3-55a4-4dd7-b650-36d48cb20edd None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:31.795901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7ffef2f3-55a4-4dd7-b650-36d48cb20edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:31.938641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 515/1028] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 10:57:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:36.076167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f735e-dc75-440c-9730-dcb863e2b4b4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:36.076775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f735e-dc75-440c-9730-dcb863e2b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:36.076775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f735e-dc75-440c-9730-dcb863e2b4b4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:36.078235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 514/1029] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 10:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:36.083253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d32f16-f123-47c4-ac3e-cbf295888dad None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:36.083744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d32f16-f123-47c4-ac3e-cbf295888dad None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:36.084748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d32f16-f123-47c4-ac3e-cbf295888dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:36.145478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:36.169339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=59 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:36.172154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-92d32f16-f123-47c4-ac3e-cbf295888dad None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:36.173507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-92d32f16-f123-47c4-ac3e-cbf295888dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:36.283476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 516/1030] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 10:57:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:37.686184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa979a9-d193-4429-adea-30e30c5d4d80 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:37.686754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa979a9-d193-4429-adea-30e30c5d4d80 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:37.686754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa979a9-d193-4429-adea-30e30c5d4d80 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:37.688042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 515/1031] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:37.693221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdfe12-b172-471d-be6a-aac294616941 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:37.693657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdfe12-b172-471d-be6a-aac294616941 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:37.693872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdfe12-b172-471d-be6a-aac294616941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:37.771194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-43bdfe12-b172-471d-be6a-aac294616941 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:37.772498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-43bdfe12-b172-471d-be6a-aac294616941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:37.814720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:37.882168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 517/1032] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:41.411863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2c75-6452-4ce3-820c-9a6b8a27860f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:41.412746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2c75-6452-4ce3-820c-9a6b8a27860f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:41.413185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2c75-6452-4ce3-820c-9a6b8a27860f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:41.415070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 516/1033] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:41.421437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45cea-2e7f-4dd7-bc4d-f908ee12b022 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:41.421927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45cea-2e7f-4dd7-bc4d-f908ee12b022 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:41.422292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45cea-2e7f-4dd7-bc4d-f908ee12b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:41.494300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f0d45cea-2e7f-4dd7-bc4d-f908ee12b022 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:41.496271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f0d45cea-2e7f-4dd7-bc4d-f908ee12b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:41.601987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 518/1034] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:41.911654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce497b73-32ab-4e6d-a600-bb312aa5ea86 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:41.912433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce497b73-32ab-4e6d-a600-bb312aa5ea86 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:41.912957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce497b73-32ab-4e6d-a600-bb312aa5ea86 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:41.915603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 517/1035] 10.222.0.49 () {54 vars in 961 bytes} [Wed Oct 26 10:57:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:41.923632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10bf4-a0be-4587-ad15-69e93f896ce2 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:41.924658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10bf4-a0be-4587-ad15-69e93f896ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:41.926149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10bf4-a0be-4587-ad15-69e93f896ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:41.951176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:42.026217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3ad10bf4-a0be-4587-ad15-69e93f896ce2 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:42.027924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3ad10bf4-a0be-4587-ad15-69e93f896ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:42.157112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 519/1036] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Oct 26 10:57:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:42.166062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce497b73-32ab-4e6d-a600-bb312aa5ea86 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:42.167878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ce497b73-32ab-4e6d-a600-bb312aa5ea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:42.327223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce497b73-32ab-4e6d-a600-bb312aa5ea86 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:42.407901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:42.452781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:42.453563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:42.454048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:42.454431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:42.456226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:42.564293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:42.565960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5f853-671b-4c84-8d7c-cad73631c462 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:42.585070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 518/1037] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:44.953767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3878b-c0b0-4813-a43b-9517c96c2380 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:44.954341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3878b-c0b0-4813-a43b-9517c96c2380 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:44.954341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3878b-c0b0-4813-a43b-9517c96c2380 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:44.956473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 520/1038] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:44.963342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148601b-153f-4b00-9e1c-dd05db3c1708 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:44.964317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148601b-153f-4b00-9e1c-dd05db3c1708 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:44.965148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148601b-153f-4b00-9e1c-dd05db3c1708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:45.066956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4148601b-153f-4b00-9e1c-dd05db3c1708 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:45.068156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4148601b-153f-4b00-9e1c-dd05db3c1708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:45.113080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:45.180930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 519/1039] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:45.475620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3878b-c0b0-4813-a43b-9517c96c2380 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:45.477153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-89d3878b-c0b0-4813-a43b-9517c96c2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:45.547291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:45.647724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3878b-c0b0-4813-a43b-9517c96c2380 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:45.780318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:45.780955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:45.781434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:45.781715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:45.783303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:45.806788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:45.877298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:45.879471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a8de2-4e2d-4262-9028-923e5886fc2d service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:45.898492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 521/1040] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:48.394901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bf2c8-e753-47f6-8eb0-8d0ab6babce6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:48.395406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bf2c8-e753-47f6-8eb0-8d0ab6babce6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:48.395406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bf2c8-e753-47f6-8eb0-8d0ab6babce6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:48.396889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 520/1041] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:48.401922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2245ec-1dce-410d-9cae-cff13d23511f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:48.402344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2245ec-1dce-410d-9cae-cff13d23511f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:48.402518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2245ec-1dce-410d-9cae-cff13d23511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:48.472549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9c2245ec-1dce-410d-9cae-cff13d23511f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:48.473764 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9c2245ec-1dce-410d-9cae-cff13d23511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:48.577959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:48.584369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 522/1042] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:48.882891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01883d-8cce-49ab-9450-154b665f435a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:48.883176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01883d-8cce-49ab-9450-154b665f435a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:48.883451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01883d-8cce-49ab-9450-154b665f435a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:48.884952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 521/1043] 10.222.0.49 () {54 vars in 961 bytes} [Wed Oct 26 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:48.890201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67fa39-4431-4082-b2f0-c712884b8219 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:48.890813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67fa39-4431-4082-b2f0-c712884b8219 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:48.891331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67fa39-4431-4082-b2f0-c712884b8219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:48.970555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5b67fa39-4431-4082-b2f0-c712884b8219 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:48.971901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5b67fa39-4431-4082-b2f0-c712884b8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:49.102348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 523/1044] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Oct 26 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:49.110047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01883d-8cce-49ab-9450-154b665f435a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:49.111823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6e01883d-8cce-49ab-9450-154b665f435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:49.268916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01883d-8cce-49ab-9450-154b665f435a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:49.290080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:49.390082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:49.390692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:49.390972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:49.391243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:49.392870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:49.487304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:49.488941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b65685-e21e-4d40-b7fb-b57cb40f12d4 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:49.521002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 522/1045] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:49.631177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f624da-bc97-43c7-bec8-28c2a1933f5d None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:49.631738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f624da-bc97-43c7-bec8-28c2a1933f5d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:49.631738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f624da-bc97-43c7-bec8-28c2a1933f5d None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:49.633350 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 524/1046] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:49.639177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2637ac-5a97-4fcb-8650-86cb944a2e39 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:49.639470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2637ac-5a97-4fcb-8650-86cb944a2e39 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:49.639731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2637ac-5a97-4fcb-8650-86cb944a2e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:49.676837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:49.720387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9f2637ac-5a97-4fcb-8650-86cb944a2e39 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:49.721863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9f2637ac-5a97-4fcb-8650-86cb944a2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:49.839460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 523/1047] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:50.171991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3de21-15b0-41f7-b708-592fbdcb47a7 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:50.171991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3de21-15b0-41f7-b708-592fbdcb47a7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:50.171991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3de21-15b0-41f7-b708-592fbdcb47a7 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:50.174519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 525/1048] 10.222.0.49 () {54 vars in 963 bytes} [Wed Oct 26 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:50.178256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421210d-c052-423a-ae74-0874526c926e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:50.178547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421210d-c052-423a-ae74-0874526c926e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:50.178827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421210d-c052-423a-ae74-0874526c926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:50.259048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9421210d-c052-423a-ae74-0874526c926e None None] MFA Rules not processed for user `0a7700f8cf7049e18a9a530c00bb4d45`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:50.260369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9421210d-c052-423a-ae74-0874526c926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:50.310054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:50.342554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 524/1049] 10.222.0.49 () {58 vars in 1060 bytes} [Wed Oct 26 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:50.350225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3de21-15b0-41f7-b708-592fbdcb47a7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:50.351941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9ff3de21-15b0-41f7-b708-592fbdcb47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:50.408227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:50.473269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3de21-15b0-41f7-b708-592fbdcb47a7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:50.583011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:50.583577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:50.584009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:50.584327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:50.586050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:50.706084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:50.721950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:50.723384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c634ed-6644-4dda-9cd7-d36b231bb3cf service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:50.743906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 526/1050] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:51.777975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48dde0-2dd1-412e-8929-bae514de1daa None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:51.778549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48dde0-2dd1-412e-8929-bae514de1daa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:51.778549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48dde0-2dd1-412e-8929-bae514de1daa None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:51.779778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 525/1051] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:51.785522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317f691-ec3a-4254-8845-5db59926a237 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:51.785908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317f691-ec3a-4254-8845-5db59926a237 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:51.786069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317f691-ec3a-4254-8845-5db59926a237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:51.852635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e317f691-ec3a-4254-8845-5db59926a237 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:51.853857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e317f691-ec3a-4254-8845-5db59926a237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:51.950009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 527/1052] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:52.241269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48dde0-2dd1-412e-8929-bae514de1daa None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:52.242813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8b48dde0-2dd1-412e-8929-bae514de1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:52.399962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48dde0-2dd1-412e-8929-bae514de1daa None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:52.454547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:52.518325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:52.518923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:52.519202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:52.519469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:52.521085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:52.615649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:52.617269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0b27-f43e-42e0-9b85-2b2ce7adf3f8 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:52.636456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 526/1053] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:54.856070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89375-4f4b-4caf-9988-4273f6252075 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:54.856637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89375-4f4b-4caf-9988-4273f6252075 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:54.856637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89375-4f4b-4caf-9988-4273f6252075 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:54.858128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 528/1054] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:54.864138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc045ad7-43f2-463b-ac0f-52dd5fbe530c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:54.864642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc045ad7-43f2-463b-ac0f-52dd5fbe530c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:54.864733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc045ad7-43f2-463b-ac0f-52dd5fbe530c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:54.937506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-dc045ad7-43f2-463b-ac0f-52dd5fbe530c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:54.938721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dc045ad7-43f2-463b-ac0f-52dd5fbe530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:54.947496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:55.050194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 527/1055] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:55.339317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89375-4f4b-4caf-9988-4273f6252075 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:55.341118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1fd89375-4f4b-4caf-9988-4273f6252075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:55.408303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:55.502388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89375-4f4b-4caf-9988-4273f6252075 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:55.622547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:55.623238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:55.623606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:55.623971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:55.625648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:55.646477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:55.724075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:55.725812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de118a-9bed-4124-bb4a-ed85f23b1075 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:55.745468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 529/1056] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:57:57.948674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5ed5-985f-421e-8951-5c6d31de22fc None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:57.949253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5ed5-985f-421e-8951-5c6d31de22fc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:57.949253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5ed5-985f-421e-8951-5c6d31de22fc None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:57.950868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 528/1057] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:57:57.955940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1212-74e2-4408-83b8-d33def99f462 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:57.956360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1212-74e2-4408-83b8-d33def99f462 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:57.956544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1212-74e2-4408-83b8-d33def99f462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:58.025363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-950b1212-74e2-4408-83b8-d33def99f462 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:57:58.026577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-950b1212-74e2-4408-83b8-d33def99f462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:58.143883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:58.165394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 530/1058] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:57:58.443827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b5ed5-985f-421e-8951-5c6d31de22fc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:57:58.445346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-826b5ed5-985f-421e-8951-5c6d31de22fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:58.605246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:58.621634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b5ed5-985f-421e-8951-5c6d31de22fc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:57:58.770632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:57:58.771269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:57:58.771563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:57:58.771851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:57:58.773622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:57:58.887037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:57:58.888669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f738d-6c33-40c4-84ab-c0520b646a55 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:57:58.899379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:57:58.909653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 529/1059] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:01.465238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb0088-150c-42c8-a25d-71f96d03c156 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:01.466439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb0088-150c-42c8-a25d-71f96d03c156 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:01.466439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb0088-150c-42c8-a25d-71f96d03c156 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:01.468397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 531/1060] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:01.475075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582a96d-9fcb-4f07-bf4c-58cd7612d982 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:01.475653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582a96d-9fcb-4f07-bf4c-58cd7612d982 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:01.475976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582a96d-9fcb-4f07-bf4c-58cd7612d982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:01.559457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b582a96d-9fcb-4f07-bf4c-58cd7612d982 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:01.560705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b582a96d-9fcb-4f07-bf4c-58cd7612d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:01.671476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 530/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:01.963426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb0088-150c-42c8-a25d-71f96d03c156 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:01.964973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5dbb0088-150c-42c8-a25d-71f96d03c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:02.134437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb0088-150c-42c8-a25d-71f96d03c156 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:02.205222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:02.261566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:02.262282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:02.262625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:02.262960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:02.264907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:02.367923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:02.369558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3ca5f-6207-4ad7-9fc7-5da99909d7d1 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:02.389655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 532/1062] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:04.546090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02f97-78f7-4eef-b46f-bd4737338123 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:04.546636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02f97-78f7-4eef-b46f-bd4737338123 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:04.546636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02f97-78f7-4eef-b46f-bd4737338123 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:04.547898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 531/1063] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:04.553780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe239-2c6b-4fe9-9bac-bc19e6bb2f4d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:04.554206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe239-2c6b-4fe9-9bac-bc19e6bb2f4d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:04.554313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe239-2c6b-4fe9-9bac-bc19e6bb2f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:04.620832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b79fe239-2c6b-4fe9-9bac-bc19e6bb2f4d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:04.622046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b79fe239-2c6b-4fe9-9bac-bc19e6bb2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:04.654875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:04.724645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 533/1064] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:05.013255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02f97-78f7-4eef-b46f-bd4737338123 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:05.014897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-42b02f97-78f7-4eef-b46f-bd4737338123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:05.099891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:05.175466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02f97-78f7-4eef-b46f-bd4737338123 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:05.288413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:05.289013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:05.289286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:05.289552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:05.291139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:05.330356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:05.384027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:05.385645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d16b-2f30-4da8-af8b-7af0b052aa74 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:05.404354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 532/1065] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:05.966563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290837d8-87cd-4846-8ab6-9d344d7faa5c None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:05.967128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290837d8-87cd-4846-8ab6-9d344d7faa5c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:05.967128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290837d8-87cd-4846-8ab6-9d344d7faa5c None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:05.968476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 534/1066] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:05.973829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1afe7-d61f-4f0b-818f-7dd71d9a84a4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:05.974279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1afe7-d61f-4f0b-818f-7dd71d9a84a4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:05.974407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1afe7-d61f-4f0b-818f-7dd71d9a84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:06.040625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-33f1afe7-d61f-4f0b-818f-7dd71d9a84a4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:06.041830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-33f1afe7-d61f-4f0b-818f-7dd71d9a84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:06.139765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 533/1067] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:06.443372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612e6f-fba3-4e02-9a85-89058394c170 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:06.443731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612e6f-fba3-4e02-9a85-89058394c170 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:06.444097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612e6f-fba3-4e02-9a85-89058394c170 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:06.445657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 535/1068] 10.222.0.49 () {54 vars in 962 bytes} [Wed Oct 26 10:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:58:06.451121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5655a-b625-4bf1-b2b5-1354aaca5f19 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:06.451405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5655a-b625-4bf1-b2b5-1354aaca5f19 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:06.451677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5655a-b625-4bf1-b2b5-1354aaca5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:06.467231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:06.527618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-99c5655a-b625-4bf1-b2b5-1354aaca5f19 None None] MFA Rules not processed for user `dd246bbbfb444cd19f8e53157e2973e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:06.528839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-99c5655a-b625-4bf1-b2b5-1354aaca5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:06.607033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 534/1069] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Oct 26 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:06.615873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612e6f-fba3-4e02-9a85-89058394c170 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:06.617432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-93612e6f-fba3-4e02-9a85-89058394c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:06.724666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612e6f-fba3-4e02-9a85-89058394c170 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:06.785392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:06.802291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:06.802923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:06.803205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:06.803478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:06.805106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:06.918700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:06.920132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04222a-a837-4d56-8dd4-90c15a73b406 service glance] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:06.937884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 536/1070] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:07.626055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee42e-e23c-4bf0-a9ce-142084c78a89 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:07.626573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee42e-e23c-4bf0-a9ce-142084c78a89 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:07.626689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee42e-e23c-4bf0-a9ce-142084c78a89 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:07.628600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 535/1071] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:07.633804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29f817-f918-495a-9a07-906ea7b4b7e7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:07.634237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29f817-f918-495a-9a07-906ea7b4b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:07.634586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29f817-f918-495a-9a07-906ea7b4b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:07.688144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175709b-1624-4032-9bcf-586ea01612a1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:07.688554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175709b-1624-4032-9bcf-586ea01612a1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:07.689216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175709b-1624-4032-9bcf-586ea01612a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:07.709129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7b29f817-f918-495a-9a07-906ea7b4b7e7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:07.710338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7b29f817-f918-495a-9a07-906ea7b4b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:07.754254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:07.760763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9175709b-1624-4032-9bcf-586ea01612a1 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:07.761978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9175709b-1624-4032-9bcf-586ea01612a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:07.812944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 537/1072] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:07.817047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:07.848170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 536/1073] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 10:58:07.896696 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c9c78-8443-4c6d-933e-84ed92a7f483 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:07.896988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c9c78-8443-4c6d-933e-84ed92a7f483 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:07.897262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c9c78-8443-4c6d-933e-84ed92a7f483 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:07.898625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 538/1074] 10.222.0.49 () {54 vars in 943 bytes} [Wed Oct 26 10:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:07.905199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:07.905490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:07.905765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:07.982225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] MFA Rules not processed for user `98484e9a9d8d41b8ade7fca3f65d10ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:07.983417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:08.088653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 537/1075] 10.222.0.49 () {58 vars in 1040 bytes} [Wed Oct 26 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:08.099868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c9c78-8443-4c6d-933e-84ed92a7f483 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:08.101432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1e9c9c78-8443-4c6d-933e-84ed92a7f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:08.105624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:08.106808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:08.138833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:08.204883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e1f65-78a8-4e97-b916-e3915ef841b0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:08.243601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c9c78-8443-4c6d-933e-84ed92a7f483 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:08.280711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:08.319986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:08.320628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:08.320903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:08.321181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:08.323055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:08.349149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:08.349788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:08.350073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:08.350349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:08.351974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:08.366428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:08.414739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:08.416295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c149d-c8d4-4b8b-ac5e-da2b659e699d service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:08.433991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 538/1076] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 10:58:08.437212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:08.438796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a1b4c-3901-4b72-9507-e5ce96201586 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:08.446934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 539/1077] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 10:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 10:58:10.668059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e74a1-bee9-43f0-b632-882fe9fcb2ec None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:10.668621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e74a1-bee9-43f0-b632-882fe9fcb2ec None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:10.668925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e74a1-bee9-43f0-b632-882fe9fcb2ec None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:10.670422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 539/1078] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:10.676117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414af85-fcd6-4d2a-a15a-e5a06e86b0ab None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:10.676586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414af85-fcd6-4d2a-a15a-e5a06e86b0ab None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:10.676769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414af85-fcd6-4d2a-a15a-e5a06e86b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:10.751203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7414af85-fcd6-4d2a-a15a-e5a06e86b0ab None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:10.753079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7414af85-fcd6-4d2a-a15a-e5a06e86b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:10.807692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:10.912439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 540/1079] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:11.201605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e74a1-bee9-43f0-b632-882fe9fcb2ec None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:11.203116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-447e74a1-bee9-43f0-b632-882fe9fcb2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:11.362403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e74a1-bee9-43f0-b632-882fe9fcb2ec None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:11.383223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:11.488215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:11.488215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:11.488215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:11.488215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:11.489923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:11.588480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:11.590222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de69d33-fe42-4beb-bcd2-caf22842ff7f service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:11.611498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 540/1080] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:13.818534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e2c08-f146-4ba5-9dc9-6577ea145f65 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:13.819100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e2c08-f146-4ba5-9dc9-6577ea145f65 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:13.819100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e2c08-f146-4ba5-9dc9-6577ea145f65 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:13.820584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 541/1081] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:13.825708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e7cf-3f69-435e-9d69-b305ae329248 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:13.826162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e7cf-3f69-435e-9d69-b305ae329248 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:13.826263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e7cf-3f69-435e-9d69-b305ae329248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:13.866636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:13.906956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1307e7cf-3f69-435e-9d69-b305ae329248 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:13.908815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1307e7cf-3f69-435e-9d69-b305ae329248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:14.040361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 541/1082] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:14.325185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e2c08-f146-4ba5-9dc9-6577ea145f65 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:14.326861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-576e2c08-f146-4ba5-9dc9-6577ea145f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:14.490063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e2c08-f146-4ba5-9dc9-6577ea145f65 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:14.492885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:14.621151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:14.622179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:14.622686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:14.623173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:14.624991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:14.724987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:14.726569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f3308-1da9-4008-a5d5-d0d27ceb3621 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:14.745974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 542/1083] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:16.999869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b471e51-04a3-4d39-bdb9-4028f0a9eb70 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:17.000428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b471e51-04a3-4d39-bdb9-4028f0a9eb70 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:17.000428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b471e51-04a3-4d39-bdb9-4028f0a9eb70 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:17.002490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 542/1084] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:17.007670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b6cd-3072-491e-8ca8-061696ef8568 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:17.008095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b6cd-3072-491e-8ca8-061696ef8568 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:17.008300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b6cd-3072-491e-8ca8-061696ef8568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:17.019587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:17.080701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ccb1b6cd-3072-491e-8ca8-061696ef8568 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:17.082026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ccb1b6cd-3072-491e-8ca8-061696ef8568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:17.187900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 543/1085] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:17.476910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b471e51-04a3-4d39-bdb9-4028f0a9eb70 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:17.478501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2b471e51-04a3-4d39-bdb9-4028f0a9eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:17.592657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:17.645116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b471e51-04a3-4d39-bdb9-4028f0a9eb70 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:17.774129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:17.774831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:17.775195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:17.775532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:17.777254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:17.851838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:17.879311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:17.881106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d4948-8431-4fe1-89b2-f0452147b4f4 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:17.899531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 543/1086] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:27.193664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=62 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:27.896783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=16 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:31.867420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651241b2-7c41-4984-85d6-0b051e4c7843 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:31.867995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651241b2-7c41-4984-85d6-0b051e4c7843 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:31.867995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651241b2-7c41-4984-85d6-0b051e4c7843 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:31.869356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 544/1087] 10.222.0.49 () {54 vars in 918 bytes} [Wed Oct 26 10:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:31.874266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a26e5e-d20e-47da-b4c9-605e58bb9bc5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:31.874671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a26e5e-d20e-47da-b4c9-605e58bb9bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:31.874803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a26e5e-d20e-47da-b4c9-605e58bb9bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:31.950223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-84a26e5e-d20e-47da-b4c9-605e58bb9bc5 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:31.951431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-84a26e5e-d20e-47da-b4c9-605e58bb9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:32.055451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 544/1088] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Oct 26 10:58:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 10:58:32.070110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463e84-f943-49be-b6c6-6c3912e523ab None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:32.070389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463e84-f943-49be-b6c6-6c3912e523ab None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:32.070660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463e84-f943-49be-b6c6-6c3912e523ab None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:32.071996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 545/1089] 10.222.0.49 () {54 vars in 918 bytes} [Wed Oct 26 10:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:32.076476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754ea0-ac80-4cd6-b294-778c26a67faf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:32.076767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754ea0-ac80-4cd6-b294-778c26a67faf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:32.077046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754ea0-ac80-4cd6-b294-778c26a67faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:32.149469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:32.152243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-39754ea0-ac80-4cd6-b294-778c26a67faf None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:32.154105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-39754ea0-ac80-4cd6-b294-778c26a67faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:32.267219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 545/1090] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Oct 26 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:34.818623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddec1c-3c2d-4133-bd25-2ccc4ebe1def None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:34.819155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddec1c-3c2d-4133-bd25-2ccc4ebe1def None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:34.819155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddec1c-3c2d-4133-bd25-2ccc4ebe1def None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:34.820508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 546/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:34.825757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c320e5-3693-45b3-a26c-7b5e2976f003 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:34.826192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c320e5-3693-45b3-a26c-7b5e2976f003 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:34.826296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c320e5-3693-45b3-a26c-7b5e2976f003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:34.893414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-44c320e5-3693-45b3-a26c-7b5e2976f003 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:34.894555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-44c320e5-3693-45b3-a26c-7b5e2976f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:34.947746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:34.989050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 546/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:35.277484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddec1c-3c2d-4133-bd25-2ccc4ebe1def None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:35.278990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-71ddec1c-3c2d-4133-bd25-2ccc4ebe1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:35.421606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddec1c-3c2d-4133-bd25-2ccc4ebe1def None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:35.492721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:35.531310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:35.532393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:35.532671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:35.532937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:35.534625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:35.622730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:35.624288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152073ff-c32b-486f-87d6-0b0fcf4dfc48 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:35.641627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 547/1093] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:36.769828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07ad70-51e7-4073-9a02-766cf1ffe274 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:36.770373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07ad70-51e7-4073-9a02-766cf1ffe274 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:36.770373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07ad70-51e7-4073-9a02-766cf1ffe274 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:36.771689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 547/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:36.776534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f036c-e6e3-4e27-b128-427a5138d5a4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:36.776934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f036c-e6e3-4e27-b128-427a5138d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:36.777086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f036c-e6e3-4e27-b128-427a5138d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:36.853042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f84f036c-e6e3-4e27-b128-427a5138d5a4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:36.854179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f84f036c-e6e3-4e27-b128-427a5138d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:36.881395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:36.950474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 548/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:37.107656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07ad70-51e7-4073-9a02-766cf1ffe274 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:37.109141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1d07ad70-51e7-4073-9a02-766cf1ffe274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:37.252816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07ad70-51e7-4073-9a02-766cf1ffe274 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:37.292393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:37.366075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:37.366688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:37.367062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:37.367337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:37.368968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:37.457522 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:37.459094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c74a9-c436-45a6-880d-65c1588ada94 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:37.476570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 548/1096] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:38.586427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815075e-e307-49fa-aef6-3ee00c0eb113 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:38.586995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815075e-e307-49fa-aef6-3ee00c0eb113 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:38.586995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815075e-e307-49fa-aef6-3ee00c0eb113 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:38.588310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 549/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:38.593275 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c033-dc45-4e7b-bb74-49a6250a5abf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:38.593700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c033-dc45-4e7b-bb74-49a6250a5abf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:38.593821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c033-dc45-4e7b-bb74-49a6250a5abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:38.648533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:38.669888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-71e4c033-dc45-4e7b-bb74-49a6250a5abf None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:38.671074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-71e4c033-dc45-4e7b-bb74-49a6250a5abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:38.768000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 549/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:38.917796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815075e-e307-49fa-aef6-3ee00c0eb113 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:38.919294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0815075e-e307-49fa-aef6-3ee00c0eb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:39.062462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815075e-e307-49fa-aef6-3ee00c0eb113 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:39.074872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:39.175386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:39.175914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:39.176194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:39.176502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:39.178100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:39.266663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:39.268246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72828-0994-4905-9755-f351e897eee1 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:39.286231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 550/1099] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:40.377400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df67f-f67c-4e2f-94fb-798eba8ac3cf None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:40.377915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df67f-f67c-4e2f-94fb-798eba8ac3cf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:40.377915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df67f-f67c-4e2f-94fb-798eba8ac3cf None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:40.379198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 550/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:40.384069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f603ab-bc50-4d2b-88d9-c51e5d0e8698 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:40.384549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f603ab-bc50-4d2b-88d9-c51e5d0e8698 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:40.384647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f603ab-bc50-4d2b-88d9-c51e5d0e8698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:40.404475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:40.460126 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c5f603ab-bc50-4d2b-88d9-c51e5d0e8698 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:40.461374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c5f603ab-bc50-4d2b-88d9-c51e5d0e8698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:40.557594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 551/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:40.705634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df67f-f67c-4e2f-94fb-798eba8ac3cf None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:40.707101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-802df67f-f67c-4e2f-94fb-798eba8ac3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:40.816061 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:40.851388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df67f-f67c-4e2f-94fb-798eba8ac3cf None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:40.961524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:40.962046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:40.962321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:40.962587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:40.964170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:41.040902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:41.054320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:41.055900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939b511-ab2a-4eff-8dfa-104e52538791 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:41.073410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 551/1102] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:42.173944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df5e7-f92a-404a-a057-b633571e21bb None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:42.174485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df5e7-f92a-404a-a057-b633571e21bb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:42.174485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df5e7-f92a-404a-a057-b633571e21bb None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:42.175826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 552/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:42.180803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a8752-ae93-4ea4-ad56-c342dbddf245 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:42.181209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a8752-ae93-4ea4-ad56-c342dbddf245 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:42.181380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a8752-ae93-4ea4-ad56-c342dbddf245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:42.256838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-306a8752-ae93-4ea4-ad56-c342dbddf245 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:42.258033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-306a8752-ae93-4ea4-ad56-c342dbddf245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:42.351189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 552/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:42.501642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df5e7-f92a-404a-a057-b633571e21bb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:42.503149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5b0df5e7-f92a-404a-a057-b633571e21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:42.586588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:42.647691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df5e7-f92a-404a-a057-b633571e21bb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:42.760303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:42.760945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:42.761244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:42.761508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:42.763084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:42.810396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:42.851444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:42.853079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ccd86-2f17-4162-9a50-211fb8a798f1 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:42.871488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 553/1105] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:43.903178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c89e71-00b0-4269-b96c-86b4cab9f510 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:43.903755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c89e71-00b0-4269-b96c-86b4cab9f510 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:43.903755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c89e71-00b0-4269-b96c-86b4cab9f510 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:43.905093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 553/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:43.910430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7e2d3-5b9e-41d0-915a-bebdd8425423 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:43.910857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7e2d3-5b9e-41d0-915a-bebdd8425423 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:43.911007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7e2d3-5b9e-41d0-915a-bebdd8425423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:43.986261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-71b7e2d3-5b9e-41d0-915a-bebdd8425423 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:43.987444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-71b7e2d3-5b9e-41d0-915a-bebdd8425423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:44.083062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 554/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:44.233561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c89e71-00b0-4269-b96c-86b4cab9f510 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:44.235336 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-97c89e71-00b0-4269-b96c-86b4cab9f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:44.284706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:44.383574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c89e71-00b0-4269-b96c-86b4cab9f510 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:44.492496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:44.493036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:44.493316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:44.493587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:44.495188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:44.502644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:44.584809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:44.586375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffc5cd-dd85-4f62-bd22-eb365a45f2fe service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:44.604131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 554/1108] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:45.659508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff1d8-c8b2-4dd2-a174-eacaf6861a2e None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:45.660150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff1d8-c8b2-4dd2-a174-eacaf6861a2e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:45.660150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff1d8-c8b2-4dd2-a174-eacaf6861a2e None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:45.661446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 555/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:45.666222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa1bb-4e37-4980-bc3f-5727c6030893 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:45.666683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa1bb-4e37-4980-bc3f-5727c6030893 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:45.666786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa1bb-4e37-4980-bc3f-5727c6030893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:45.741035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-65eaa1bb-4e37-4980-bc3f-5727c6030893 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:45.742240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-65eaa1bb-4e37-4980-bc3f-5727c6030893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:45.809128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:45.838087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 555/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:45.988789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff1d8-c8b2-4dd2-a174-eacaf6861a2e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:45.990216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-946ff1d8-c8b2-4dd2-a174-eacaf6861a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:46.007720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:46.134546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff1d8-c8b2-4dd2-a174-eacaf6861a2e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:46.220987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:46.247665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:46.248205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:46.248508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:46.248778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:46.250381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:46.337881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:46.339461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16acb-b46e-4e84-92ae-c359eec70d75 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:46.357722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 556/1111] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:47.393526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fde34-04b2-421e-99f4-6421bebfbc5b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:47.394038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fde34-04b2-421e-99f4-6421bebfbc5b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:47.394136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fde34-04b2-421e-99f4-6421bebfbc5b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:47.395431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 556/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:47.400554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b452a8-6c53-47c7-b2d5-418369fd371f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:47.400959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b452a8-6c53-47c7-b2d5-418369fd371f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:47.401093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b452a8-6c53-47c7-b2d5-418369fd371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:47.476756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e3b452a8-6c53-47c7-b2d5-418369fd371f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:47.477949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e3b452a8-6c53-47c7-b2d5-418369fd371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:47.519378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:47.573620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 557/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:47.724379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fde34-04b2-421e-99f4-6421bebfbc5b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:47.725906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-290fde34-04b2-421e-99f4-6421bebfbc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:47.871202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fde34-04b2-421e-99f4-6421bebfbc5b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:47.925216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:47.983657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:47.984190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:47.984541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:47.984811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:47.986672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:48.074776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:48.076370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956f302-8bc6-4793-a849-ae41ce3f3b02 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:48.094037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 557/1114] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:49.129556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca919-03bf-4af8-8831-fcbaec79bb3f None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:49.130036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca919-03bf-4af8-8831-fcbaec79bb3f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:49.130206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca919-03bf-4af8-8831-fcbaec79bb3f None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:49.131545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 558/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 10:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:49.136553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b6c4e-c130-45ca-ba64-07f98f1fb54f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:49.137004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b6c4e-c130-45ca-ba64-07f98f1fb54f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:49.137101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b6c4e-c130-45ca-ba64-07f98f1fb54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:49.211512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f94b6c4e-c130-45ca-ba64-07f98f1fb54f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:49.212741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f94b6c4e-c130-45ca-ba64-07f98f1fb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:49.214719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:49.307418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 558/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 10:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:49.459400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deca919-03bf-4af8-8831-fcbaec79bb3f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:49.460852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3deca919-03bf-4af8-8831-fcbaec79bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:49.609356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deca919-03bf-4af8-8831-fcbaec79bb3f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:49.637535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:49.721739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:49.722259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:49.722530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:49.722796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:49.724375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:49.813352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:49.814930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bfea1-5a38-4b35-9aff-5e24b3a15195 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:49.833198 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 559/1117] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:51.888729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0e61-4479-4c62-ad6f-1fa898fd133b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:51.889279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0e61-4479-4c62-ad6f-1fa898fd133b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:51.889279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0e61-4479-4c62-ad6f-1fa898fd133b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:51.890663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 559/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:51.896225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae610-4d51-4d9b-b458-c495102a5c2a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:51.896653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae610-4d51-4d9b-b458-c495102a5c2a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:51.896814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae610-4d51-4d9b-b458-c495102a5c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:51.938679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:51.964221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-155ae610-4d51-4d9b-b458-c495102a5c2a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:51.965522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-155ae610-4d51-4d9b-b458-c495102a5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:52.061545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 560/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:52.343490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d0e61-4479-4c62-ad6f-1fa898fd133b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:52.345087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c92d0e61-4479-4c62-ad6f-1fa898fd133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:52.447421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d0e61-4479-4c62-ad6f-1fa898fd133b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:52.478665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:52.520058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:52.520676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:52.520951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:52.521215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:52.522776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:52.629692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:52.631111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3d12b-e403-41bd-ad32-f792903586a1 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:52.648415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 560/1120] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:54.930741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cf6d5-09b0-4002-8bd6-a51168585a50 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:54.931283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cf6d5-09b0-4002-8bd6-a51168585a50 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:54.931283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cf6d5-09b0-4002-8bd6-a51168585a50 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:54.932662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 561/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:54.937756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff709-1044-4ade-ab4f-fbc0ae9a3848 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:54.938166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff709-1044-4ade-ab4f-fbc0ae9a3848 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:54.938334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff709-1044-4ade-ab4f-fbc0ae9a3848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:55.003614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ab3ff709-1044-4ade-ab4f-fbc0ae9a3848 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:55.004850 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ab3ff709-1044-4ade-ab4f-fbc0ae9a3848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:55.017871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:55.100465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 561/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:55.386146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cf6d5-09b0-4002-8bd6-a51168585a50 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:55.387672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d65cf6d5-09b0-4002-8bd6-a51168585a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:55.489261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cf6d5-09b0-4002-8bd6-a51168585a50 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:55.502256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:55.563420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:55.564019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:55.564298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:55.564603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:55.566195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:55.675160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:55.676545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43690e15-8f27-476c-9e06-bd91d911c56d service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:55.693966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 562/1123] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:58:58.121349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972c057-c841-4883-bdfc-811a452dfa3f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:58.121824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972c057-c841-4883-bdfc-811a452dfa3f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:58.121966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972c057-c841-4883-bdfc-811a452dfa3f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:58.123216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 562/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:58:58.128475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec0863-9668-4f56-9873-ae08f804c713 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:58.128910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec0863-9668-4f56-9873-ae08f804c713 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:58.129032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec0863-9668-4f56-9873-ae08f804c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:58.177186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:58.195005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5aec0863-9668-4f56-9873-ae08f804c713 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:58:58.196213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5aec0863-9668-4f56-9873-ae08f804c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:58.291299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 563/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:58:58.574970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972c057-c841-4883-bdfc-811a452dfa3f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:58:58.576577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7972c057-c841-4883-bdfc-811a452dfa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:58.679321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972c057-c841-4883-bdfc-811a452dfa3f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:58:58.717595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:58:58.751542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:58:58.752142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:58:58.752436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:58:58.752703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:58:58.754279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:58:58.860435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:58:58.861847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969f370-940b-4e8d-a428-4046f349fcbb service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:58:58.879468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 563/1126] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:01.159017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388652ab-a7ce-4e5d-bcfe-7e6dbcd01921 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:01.159533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388652ab-a7ce-4e5d-bcfe-7e6dbcd01921 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:01.159660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388652ab-a7ce-4e5d-bcfe-7e6dbcd01921 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:01.160932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 564/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:01.166374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8e6e-fb84-4316-8113-8467d823a2c7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:01.166831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8e6e-fb84-4316-8113-8467d823a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:01.166942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8e6e-fb84-4316-8113-8467d823a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:01.231758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-53dc8e6e-fb84-4316-8113-8467d823a2c7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:01.232979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53dc8e6e-fb84-4316-8113-8467d823a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:01.253699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:01.329590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 564/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:01.616035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388652ab-a7ce-4e5d-bcfe-7e6dbcd01921 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:01.617618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-388652ab-a7ce-4e5d-bcfe-7e6dbcd01921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:01.720282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388652ab-a7ce-4e5d-bcfe-7e6dbcd01921 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:01.741101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:01.794503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:01.795101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:01.795384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:01.795656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:01.797814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:01.910361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:01.911691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1904be-9167-4775-957c-86efeef26444 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:01.929779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 565/1129] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:04.136937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470ab3-9e1b-4134-9af9-e462d1338121 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:04.137454 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470ab3-9e1b-4134-9af9-e462d1338121 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:04.137552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470ab3-9e1b-4134-9af9-e462d1338121 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:04.138846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 565/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:04.144524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717219f8-0f2c-46ff-8712-5ce295ece0e7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:04.144971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717219f8-0f2c-46ff-8712-5ce295ece0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:04.145076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717219f8-0f2c-46ff-8712-5ce295ece0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:04.207353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:04.210226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-717219f8-0f2c-46ff-8712-5ce295ece0e7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:04.211906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-717219f8-0f2c-46ff-8712-5ce295ece0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:04.306749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 566/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:04.588294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac470ab3-9e1b-4134-9af9-e462d1338121 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:04.589889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ac470ab3-9e1b-4134-9af9-e462d1338121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:04.691096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac470ab3-9e1b-4134-9af9-e462d1338121 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:04.739024 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:04.763339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:04.763935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:04.764211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:04.764518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:04.766735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:04.871656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:04.873018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7eb25-6c27-45c2-9e0e-7ca3a85793e1 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:04.891689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 566/1132] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:07.084485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fd7e-6486-46dc-a9e1-c2f9a58cfee5 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:07.085076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fd7e-6486-46dc-a9e1-c2f9a58cfee5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:07.085076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fd7e-6486-46dc-a9e1-c2f9a58cfee5 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:07.086364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 567/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:07.091645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e34c-1f39-4b4e-8d06-8dbc779748a0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:07.092087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e34c-1f39-4b4e-8d06-8dbc779748a0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:07.092310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e34c-1f39-4b4e-8d06-8dbc779748a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:07.158378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b432e34c-1f39-4b4e-8d06-8dbc779748a0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:07.159560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b432e34c-1f39-4b4e-8d06-8dbc779748a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:07.189394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:07.257277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 567/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:07.541878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fd7e-6486-46dc-a9e1-c2f9a58cfee5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:07.543425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-32a1fd7e-6486-46dc-a9e1-c2f9a58cfee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:07.644686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fd7e-6486-46dc-a9e1-c2f9a58cfee5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:07.673447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:07.717671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:07.718275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:07.719053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:07.719323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:07.720930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:07.830320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:07.831748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160370d8-101a-4a31-811e-5f56cebb73ec service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:07.849452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 568/1135] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:10.149240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb10011-f62c-42e9-927f-8c48fcd38f64 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:10.149822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb10011-f62c-42e9-927f-8c48fcd38f64 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:10.149822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb10011-f62c-42e9-927f-8c48fcd38f64 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:10.151131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:10.156423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852576d9-24f8-4689-9fdd-5e3de15273c6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:10.156876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852576d9-24f8-4689-9fdd-5e3de15273c6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:10.156985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852576d9-24f8-4689-9fdd-5e3de15273c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:10.222010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-852576d9-24f8-4689-9fdd-5e3de15273c6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:10.223205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-852576d9-24f8-4689-9fdd-5e3de15273c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:10.231390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:10.320579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:10.608536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb10011-f62c-42e9-927f-8c48fcd38f64 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:10.610868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5cb10011-f62c-42e9-927f-8c48fcd38f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:10.710950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb10011-f62c-42e9-927f-8c48fcd38f64 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:10.765910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:10.783985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:10.784602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:10.784878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:10.785149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:10.786721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:10.892052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:10.893423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a05f09-f4d0-402c-a134-c683c984dbae service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:10.911880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 569/1138] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:13.101726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efedc-9199-4789-aae7-f49d24c9ee4f None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:13.102176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efedc-9199-4789-aae7-f49d24c9ee4f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:13.102282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35efedc-9199-4789-aae7-f49d24c9ee4f None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:13.103586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:13.109084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749c64-d6e0-4118-a261-2296fcb46e07 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:13.109517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749c64-d6e0-4118-a261-2296fcb46e07 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:13.109633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749c64-d6e0-4118-a261-2296fcb46e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:13.175921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3c749c64-d6e0-4118-a261-2296fcb46e07 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:13.177150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3c749c64-d6e0-4118-a261-2296fcb46e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:13.215280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:13.276787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:13.560156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efedc-9199-4789-aae7-f49d24c9ee4f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:13.561732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f35efedc-9199-4789-aae7-f49d24c9ee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:13.665471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35efedc-9199-4789-aae7-f49d24c9ee4f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:13.702340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:13.739123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:13.739722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:13.740000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:13.740271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:13.741876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:13.849076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:13.850496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86502c3-ae94-4306-b705-b6002774a45a service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:13.868671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 571/1141] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:16.022229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64e53e-2967-430a-b8e5-95ddbf7c4fa7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:16.022802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64e53e-2967-430a-b8e5-95ddbf7c4fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:16.022802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64e53e-2967-430a-b8e5-95ddbf7c4fa7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:16.024183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:16.029529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f909299-4be2-4ae6-8225-c60dde1fbc94 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:16.029975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f909299-4be2-4ae6-8225-c60dde1fbc94 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:16.030103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f909299-4be2-4ae6-8225-c60dde1fbc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:16.095353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7f909299-4be2-4ae6-8225-c60dde1fbc94 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:16.096602 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7f909299-4be2-4ae6-8225-c60dde1fbc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:16.114816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:16.192632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:16.475891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64e53e-2967-430a-b8e5-95ddbf7c4fa7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:16.477547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4a64e53e-2967-430a-b8e5-95ddbf7c4fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:16.579461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64e53e-2967-430a-b8e5-95ddbf7c4fa7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:16.645596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:16.652564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:16.653158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:16.653432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:16.653699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:16.655293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:16.761641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:16.763004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa5e80-61da-40de-aea2-3ebbd20dc6d4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:16.780384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 572/1144] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:18.934989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f3cd-0677-4327-a935-bd376b805916 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:18.935521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f3cd-0677-4327-a935-bd376b805916 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:18.935521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f3cd-0677-4327-a935-bd376b805916 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:18.937385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 10:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:18.942565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ffcf2-7437-40c4-8613-48b7825e19b4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:18.943012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ffcf2-7437-40c4-8613-48b7825e19b4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:18.943115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ffcf2-7437-40c4-8613-48b7825e19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:19.008452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-669ffcf2-7437-40c4-8613-48b7825e19b4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:19.009663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-669ffcf2-7437-40c4-8613-48b7825e19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:19.058590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:19.106951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:19.387247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29f3cd-0677-4327-a935-bd376b805916 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:19.388791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0e29f3cd-0677-4327-a935-bd376b805916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:19.491801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29f3cd-0677-4327-a935-bd376b805916 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:19.539698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:19.569556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:19.570154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:19.570427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:19.570689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:19.572262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:19.679134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:19.680533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b41a59-c96b-4576-84a2-76bcf6f742e8 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:19.698301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 574/1147] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:29.105762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=22 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:29.696100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=66 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:39.514056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6164f-76b2-460d-a4dd-0c2ed9dc8b13 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:39.514590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6164f-76b2-460d-a4dd-0c2ed9dc8b13 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:39.514590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6164f-76b2-460d-a4dd-0c2ed9dc8b13 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:39.515915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 574/1148] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:39.521077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d948f-1bf4-4469-8039-73c2a0e4646e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:39.521541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d948f-1bf4-4469-8039-73c2a0e4646e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:39.521641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d948f-1bf4-4469-8039-73c2a0e4646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:39.587667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cb2d948f-1bf4-4469-8039-73c2a0e4646e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:39.588884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cb2d948f-1bf4-4469-8039-73c2a0e4646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:39.683437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 575/1149] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:39.984386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045b527-df9e-4ede-965b-ebf2c6c5f4f2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:39.984672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045b527-df9e-4ede-965b-ebf2c6c5f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:39.984971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045b527-df9e-4ede-965b-ebf2c6c5f4f2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:39.986572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 575/1150] 10.222.0.49 () {54 vars in 962 bytes} [Wed Oct 26 10:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:39.991428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea1723-d8de-4ae3-b59c-ed6c887745db None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:39.991712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea1723-d8de-4ae3-b59c-ed6c887745db None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:39.992006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea1723-d8de-4ae3-b59c-ed6c887745db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:40.067463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-41ea1723-d8de-4ae3-b59c-ed6c887745db None None] MFA Rules not processed for user `dd246bbbfb444cd19f8e53157e2973e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:40.068621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-41ea1723-d8de-4ae3-b59c-ed6c887745db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:40.089232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:40.145907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 576/1151] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Oct 26 10:59:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:40.153794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045b527-df9e-4ede-965b-ebf2c6c5f4f2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:40.155793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9045b527-df9e-4ede-965b-ebf2c6c5f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:40.256732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045b527-df9e-4ede-965b-ebf2c6c5f4f2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:40.330344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:40.330945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:40.331221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:40.331518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:40.333137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:40.386318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:40.440086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:40.441577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430998a5-ef02-426e-9e7e-fcbea6148598 service glance] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:40.459956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 576/1152] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:42.684409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f039a-9267-4cfe-99e8-50c7bb228024 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:42.684942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f039a-9267-4cfe-99e8-50c7bb228024 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:42.684942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f039a-9267-4cfe-99e8-50c7bb228024 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:42.686294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 577/1153] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 10:59:42.691459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc30ae5-b726-4856-961c-0719fb01b5ee None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:42.691910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc30ae5-b726-4856-961c-0719fb01b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:42.692004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc30ae5-b726-4856-961c-0719fb01b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:42.758492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1bc30ae5-b726-4856-961c-0719fb01b5ee None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:42.759709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1bc30ae5-b726-4856-961c-0719fb01b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:42.856146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 577/1154] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:43.126406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f039a-9267-4cfe-99e8-50c7bb228024 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:43.127968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-264f039a-9267-4cfe-99e8-50c7bb228024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:43.254396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f039a-9267-4cfe-99e8-50c7bb228024 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:43.305428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:43.349404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:43.350006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:43.350281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:43.350548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:43.351174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:43.352261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 10:59:43.352261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 10:59:43.352261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 10:59:43.353414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47111ce2-828d-46a5-b233-98fae2071513 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:43.372617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 578/1155] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Oct 26 10:59:43 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 10:59:45.533999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d238-6962-4b0c-a0fa-17befe20db23 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:45.534512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d238-6962-4b0c-a0fa-17befe20db23 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:45.534512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d238-6962-4b0c-a0fa-17befe20db23 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:45.535817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 578/1156] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:45.541099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4ad1-7f54-4ce7-aded-862d9ff37bd6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:45.541508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4ad1-7f54-4ce7-aded-862d9ff37bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:45.541653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4ad1-7f54-4ce7-aded-862d9ff37bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:45.607079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e7fa4ad1-7f54-4ce7-aded-862d9ff37bd6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:45.608280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e7fa4ad1-7f54-4ce7-aded-862d9ff37bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:45.702381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 579/1157] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:45.995797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d238-6962-4b0c-a0fa-17befe20db23 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:45.997387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7510d238-6962-4b0c-a0fa-17befe20db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:46.007585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:46.143807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d238-6962-4b0c-a0fa-17befe20db23 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:46.221949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:46.255004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:46.255539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:46.255817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:46.256087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:46.257714 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:46.345167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:46.346770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47d626-ea6b-4f05-9550-a5d3ae3eea4e service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:46.365276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 579/1158] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:48.672114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9133a-f51c-47fd-84d0-f5c0b49488e4 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:48.672677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9133a-f51c-47fd-84d0-f5c0b49488e4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:48.672782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9133a-f51c-47fd-84d0-f5c0b49488e4 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:48.674038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 580/1159] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:48.679426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d384549-b22d-4cdd-a84f-3fc2c5ac4ab8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:48.679868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d384549-b22d-4cdd-a84f-3fc2c5ac4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:48.679971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d384549-b22d-4cdd-a84f-3fc2c5ac4ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:48.744793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0d384549-b22d-4cdd-a84f-3fc2c5ac4ab8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:48.745986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0d384549-b22d-4cdd-a84f-3fc2c5ac4ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:48.792676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:48.842302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 580/1160] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:49.129312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9133a-f51c-47fd-84d0-f5c0b49488e4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:49.130890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c4e9133a-f51c-47fd-84d0-f5c0b49488e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:49.154531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:49.234223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9133a-f51c-47fd-84d0-f5c0b49488e4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:49.306428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:49.307022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:49.307292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:49.307553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:49.309159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:49.382120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:49.417116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:49.418531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36b15-894d-4738-ae39-97a1005008f1 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:49.436160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 581/1161] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:51.627356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c507f01-5a3e-4271-8060-e0f78dfa44e7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:51.627912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c507f01-5a3e-4271-8060-e0f78dfa44e7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:51.627912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c507f01-5a3e-4271-8060-e0f78dfa44e7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:51.629305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 581/1162] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:51.634590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c089022-9cda-4bcf-9fc6-b8772246a20c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:51.635019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c089022-9cda-4bcf-9fc6-b8772246a20c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:51.635114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c089022-9cda-4bcf-9fc6-b8772246a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:51.699299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5c089022-9cda-4bcf-9fc6-b8772246a20c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:51.700521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5c089022-9cda-4bcf-9fc6-b8772246a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:51.794450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 582/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:52.084083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c507f01-5a3e-4271-8060-e0f78dfa44e7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:52.085662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8c507f01-5a3e-4271-8060-e0f78dfa44e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:52.186990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c507f01-5a3e-4271-8060-e0f78dfa44e7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:52.257107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:52.258556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:52.259160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:52.259626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:52.260053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:52.261869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:52.368295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:52.369683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0fc76-cb80-40d8-bfbc-b1fbb1cf14c9 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:52.387923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 582/1164] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:54.627636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00abdd-e836-4698-89d7-e2df82d0824b None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:54.628207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00abdd-e836-4698-89d7-e2df82d0824b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:54.628207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00abdd-e836-4698-89d7-e2df82d0824b None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:54.629960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 583/1165] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:54.634967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c066f9-eeff-481f-9541-f2c4a72e8868 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:54.635362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c066f9-eeff-481f-9541-f2c4a72e8868 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:54.635517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c066f9-eeff-481f-9541-f2c4a72e8868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:54.700120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-54c066f9-eeff-481f-9541-f2c4a72e8868 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:54.701337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-54c066f9-eeff-481f-9541-f2c4a72e8868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:54.753410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:54.799671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 583/1166] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:55.089048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00abdd-e836-4698-89d7-e2df82d0824b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:55.090583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4e00abdd-e836-4698-89d7-e2df82d0824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:55.127022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:55.194581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00abdd-e836-4698-89d7-e2df82d0824b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:55.267474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:55.268081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:55.268388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:55.268666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:55.270256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:55.350435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:55.380459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:55.381892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454f02-0924-4403-87f8-1ba46110d40d service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:55.399963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 584/1167] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 10:59:57.711530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22bf86-3932-4715-b316-244dcff26fc4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:57.712077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22bf86-3932-4715-b316-244dcff26fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:57.712077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22bf86-3932-4715-b316-244dcff26fc4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:57.713435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 584/1168] 10.222.0.49 () {54 vars in 927 bytes} [Wed Oct 26 10:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 10:59:57.719101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c8a2-4f78-4d07-a416-9506b3ff8d50 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:57.719493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c8a2-4f78-4d07-a416-9506b3ff8d50 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:57.719666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c8a2-4f78-4d07-a416-9506b3ff8d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:57.785421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5b30c8a2-4f78-4d07-a416-9506b3ff8d50 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 10:59:57.786613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5b30c8a2-4f78-4d07-a416-9506b3ff8d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:57.882147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 585/1169] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Oct 26 10:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 10:59:58.172832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22bf86-3932-4715-b316-244dcff26fc4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 10:59:58.174436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0b22bf86-3932-4715-b316-244dcff26fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:58.276550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22bf86-3932-4715-b316-244dcff26fc4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 10:59:58.349499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 10:59:58.350030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 10:59:58.350326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 10:59:58.350578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 10:59:58.352156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 10:59:58.362012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 10:59:58.459968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 10:59:58.461417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dcb0e-1ae8-4e37-861c-2ef9af9d14b4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 10:59:58.478909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 585/1170] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 10:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:00:07.880632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=82 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:00:08.476805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=50 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:19.894255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:19.894931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:19.894931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:19.970382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:19.971580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:20.067578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 586/1171] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:20.075425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:20.075944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:20.075944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:20.151465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:20.152627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:20.246444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 586/1172] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:20.251623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:20.252913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:20.264207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd875bf0-4ecf-4adc-89a6-7b2789599573 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:20.324565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:20.359122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:20.359721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:20.359996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:20.360265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:20.360922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:01:20.361474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:20.362470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:01:20.362470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 11:01:20.362470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 11:01:20.363349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:20.374225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 587/1173] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:01:20.383559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:20.392567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7703-3a41-4a31-bda8-b0625a094416 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:20.454308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:20.486180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:20.486775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:20.487046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:20.487307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:20.487916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:20.489030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:01:20.489030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 11:01:20.489030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 11:01:20.490208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:20.544079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 587/1174] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:01:20 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:01:20.548231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:20.549791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:20.583910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172adf0-833a-4c12-887f-02bc4cd21f5e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:20.677532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:20.678131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:20.678402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:20.678664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:20.679281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:20.680473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:01:20.680473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 11:01:20.680473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 11:01:20.681477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:20.723368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 588/1175] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:01:20 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:01:20.727505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:20.729047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:20.790844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711e005-3462-44a5-b012-2760915a5175 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:20.872562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:20.883494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:20.884101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:20.884402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:20.884676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:20.885336 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:20.886912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:20.899527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 588/1176] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:01:20.904276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:20.905826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:20.917143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b3ada-489d-4292-ad52-cdf475327808 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:20.941421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:21.009942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b3343-4546-478d-8858-fdd2f9d14fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:21.010478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3343-4546-478d-8858-fdd2f9d14fec admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.010755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3343-4546-478d-8858-fdd2f9d14fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.011022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3343-4546-478d-8858-fdd2f9d14fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.011645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b3343-4546-478d-8858-fdd2f9d14fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:21.013765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b3343-4546-478d-8858-fdd2f9d14fec admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:21.027100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 589/1177] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:01:21.031956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:21.033696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:21.070020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87178f54-7d0e-40f8-ad7f-31c10e7eebe2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:21.171424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc463a-1fe2-4a25-8194-40bc7f8cdb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:21.172073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc463a-1fe2-4a25-8194-40bc7f8cdb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.172368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc463a-1fe2-4a25-8194-40bc7f8cdb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.172654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc463a-1fe2-4a25-8194-40bc7f8cdb6e admin admin] PATH_INFO: `/v3/projects/9c1cc8dd8d70426d84c87834c55f80df/users/e2297c41f9424d0cb51e878f398beb80/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.195311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc463a-1fe2-4a25-8194-40bc7f8cdb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1cc8dd8d70426d84c87834c55f80df, user_id=e2297c41f9424d0cb51e878f398beb80, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:21.198099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc463a-1fe2-4a25-8194-40bc7f8cdb6e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:21.221917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 589/1178] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:01:21 2022] PUT /identity/v3/projects/9c1cc8dd8d70426d84c87834c55f80df/users/e2297c41f9424d0cb51e878f398beb80/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:01:21.233105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da729-0031-4cd9-8798-2ada1ed96171 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.233416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da729-0031-4cd9-8798-2ada1ed96171 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.233689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da729-0031-4cd9-8798-2ada1ed96171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.290600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-484da729-0031-4cd9-8798-2ada1ed96171 None None] MFA Rules not processed for user `e2297c41f9424d0cb51e878f398beb80`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:21.291714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-484da729-0031-4cd9-8798-2ada1ed96171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:21.368226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 590/1179] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:21.381796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b2b7-da69-4655-af96-c4ddd77373a9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.382080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b2b7-da69-4655-af96-c4ddd77373a9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.382355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b2b7-da69-4655-af96-c4ddd77373a9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.383680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 590/1180] 10.222.0.49 () {54 vars in 963 bytes} [Wed Oct 26 11:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:21.388497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9e58-5791-40f2-adbc-9d118ce5afea None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.388784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9e58-5791-40f2-adbc-9d118ce5afea None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.389102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9e58-5791-40f2-adbc-9d118ce5afea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.421671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:21.467068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a31e9e58-5791-40f2-adbc-9d118ce5afea None None] MFA Rules not processed for user `0a7700f8cf7049e18a9a530c00bb4d45`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:21.468269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a31e9e58-5791-40f2-adbc-9d118ce5afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:21.542673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 591/1181] 10.222.0.49 () {58 vars in 1060 bytes} [Wed Oct 26 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:21.550390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b2b7-da69-4655-af96-c4ddd77373a9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:21.551912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1531b2b7-da69-4655-af96-c4ddd77373a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:21.602058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:21.655191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b2b7-da69-4655-af96-c4ddd77373a9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:21.727973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:21.728755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.729037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.729311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.730917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:21.829700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:21.831156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:21.834642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:21.850197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 591/1182] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:01:21.895894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53ffb-aae4-432b-a486-7b16f7d23254 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:21.896182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53ffb-aae4-432b-a486-7b16f7d23254 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:21.896495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53ffb-aae4-432b-a486-7b16f7d23254 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:21.897746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 592/1183] 10.222.0.49 () {52 vars in 830 bytes} [Wed Oct 26 11:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:01:21.901359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:21.902594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:22.000629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e83bf-286a-4627-8086-97c18db8114c service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:22.092929 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:22.093726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:22.094009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:22.094283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] PATH_INFO: `/v3/users/e2297c41f9424d0cb51e878f398beb80` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:22.107551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2297c41f9424d0cb51e878f398beb80)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:22.108602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:01:22.108602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 11:01:22.108602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 11:01:22.109805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:22.119539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:22.172971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2297c41f9424d0cb51e878f398beb80'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:22.196196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2297c41f9424d0cb51e878f398beb80'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:22.196776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2297c41f9424d0cb51e878f398beb80'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:22.210954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2297c41f9424d0cb51e878f398beb80'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:22.219721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2297c41f9424d0cb51e878f398beb80'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:22.225380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 592/1184] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:01:21 2022] DELETE /identity/v3/users/e2297c41f9424d0cb51e878f398beb80 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:01:22.229690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:22.230164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:22.230260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:22.288255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:01:22.289475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:22.363673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:22.376736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 593/1185] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:01:22.387052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:22.388648 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:22.487621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be3347-abe5-467c-b20b-ad7e5ce20831 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:22.541062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:22.562186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:22.562786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:22.563065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:22.563338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:22.564946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:22.671563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:22.672969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb352-ef32-44f2-afc7-fe39fc63898e service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:22.691716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 593/1186] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:01:23.050374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:01:23.051642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:01:23.064408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61c64-d551-4a18-be25-eb7d25a12304 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:01:23.163368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:01:23.164000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:01:23.164278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:01:23.164592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] PATH_INFO: `/v3/projects/9c1cc8dd8d70426d84c87834c55f80df` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:01:23.174976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1cc8dd8d70426d84c87834c55f80df)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:01:23.175938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:01:23.175938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 11:01:23.175938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 11:01:23.177177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:01:23.234243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1cc8dd8d70426d84c87834c55f80df', 'request_id': 'req-bf385d8f-431e-41bd-968a-cd46063603c8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:23.244314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1cc8dd8d70426d84c87834c55f80df', 'request_id': 'req-bf385d8f-431e-41bd-968a-cd46063603c8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:23.251039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1cc8dd8d70426d84c87834c55f80df', 'request_id': 'req-bf385d8f-431e-41bd-968a-cd46063603c8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:23.283551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] The token cache is being invalidate because project 9c1cc8dd8d70426d84c87834c55f80df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:01:23.283860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:23.284287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bf385d8f-431e-41bd-968a-cd46063603c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:01:23.285698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 594/1187] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:01:23 2022] DELETE /identity/v3/projects/9c1cc8dd8d70426d84c87834c55f80df => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:01:32.689463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=62 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:01:33.281370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:55.281535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625ec3-9693-4452-bd0a-ee973e6272b6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:55.282156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625ec3-9693-4452-bd0a-ee973e6272b6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:55.282156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625ec3-9693-4452-bd0a-ee973e6272b6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:55.283426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 594/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:55.288123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af2c9-1787-42ce-8b38-ec0b65389b8c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:55.288601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af2c9-1787-42ce-8b38-ec0b65389b8c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:55.288732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af2c9-1787-42ce-8b38-ec0b65389b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:55.370911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-562af2c9-1787-42ce-8b38-ec0b65389b8c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:55.372043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-562af2c9-1787-42ce-8b38-ec0b65389b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:55.472278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 595/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:55.626884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625ec3-9693-4452-bd0a-ee973e6272b6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:55.628986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-35625ec3-9693-4452-bd0a-ee973e6272b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:55.748751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625ec3-9693-4452-bd0a-ee973e6272b6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:55.754473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cefaf-ebd0-4321-8bb3-f2b0b388c239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:55.755076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cefaf-ebd0-4321-8bb3-f2b0b388c239 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:55.755357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cefaf-ebd0-4321-8bb3-f2b0b388c239 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:55.755638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cefaf-ebd0-4321-8bb3-f2b0b388c239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:55.763698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cefaf-ebd0-4321-8bb3-f2b0b388c239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:55.765317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cefaf-ebd0-4321-8bb3-f2b0b388c239 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:55.775319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 595/1190] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:56.846620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4b37c-0a31-454e-bfa8-85969159c5c4 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:56.847199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4b37c-0a31-454e-bfa8-85969159c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:56.847199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4b37c-0a31-454e-bfa8-85969159c5c4 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:56.848540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 596/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:02:56.853421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b91e-4397-45f8-8b86-49d0d70135d9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:56.854396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b91e-4397-45f8-8b86-49d0d70135d9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:56.854629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b91e-4397-45f8-8b86-49d0d70135d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:56.875113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9288b91e-4397-45f8-8b86-49d0d70135d9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:56.876322 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9288b91e-4397-45f8-8b86-49d0d70135d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:56.884307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 596/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:02:57.038409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4b37c-0a31-454e-bfa8-85969159c5c4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:02:57.053114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4b37c-0a31-454e-bfa8-85969159c5c4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:02:57.059124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acee11-0b4f-4948-81dd-1f7da8569d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:02:57.059721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acee11-0b4f-4948-81dd-1f7da8569d86 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:57.060003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acee11-0b4f-4948-81dd-1f7da8569d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:57.060276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acee11-0b4f-4948-81dd-1f7da8569d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:57.068256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acee11-0b4f-4948-81dd-1f7da8569d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:02:57.069872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acee11-0b4f-4948-81dd-1f7da8569d86 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:02:57.079205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 597/1193] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:02:57.485907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff4ab7-e4af-434f-b488-1b93953d1a49 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:57.486216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff4ab7-e4af-434f-b488-1b93953d1a49 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:57.486744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff4ab7-e4af-434f-b488-1b93953d1a49 None None] PATH_INFO: `/v3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:57.488059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 597/1194] 10.222.0.50 () {54 vars in 925 bytes} [Wed Oct 26 11:02:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:02:57.495949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27214740-175d-4ca0-afef-d79ee9c3ad86 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:02:57.496240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27214740-175d-4ca0-afef-d79ee9c3ad86 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:02:57.496547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27214740-175d-4ca0-afef-d79ee9c3ad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:02:57.555184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-27214740-175d-4ca0-afef-d79ee9c3ad86 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:02:57.556413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-27214740-175d-4ca0-afef-d79ee9c3ad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:02:57.573481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:02:57.627066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 598/1195] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Oct 26 11:02:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:01.244099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2597-e076-4745-88a0-d04389940adc None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:01.244639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2597-e076-4745-88a0-d04389940adc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:01.244831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2597-e076-4745-88a0-d04389940adc None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:01.245997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 598/1196] 10.222.0.49 () {54 vars in 961 bytes} [Wed Oct 26 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:01.251449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c68f7d-6381-4fee-8716-d4f38730ebd3 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:01.251894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c68f7d-6381-4fee-8716-d4f38730ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:01.251986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c68f7d-6381-4fee-8716-d4f38730ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:01.272672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-59c68f7d-6381-4fee-8716-d4f38730ebd3 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:01.273884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-59c68f7d-6381-4fee-8716-d4f38730ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:01.283369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 599/1197] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Oct 26 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:01.290896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2597-e076-4745-88a0-d04389940adc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:01.304324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2597-e076-4745-88a0-d04389940adc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:01.309270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde81d6-2f19-4222-938f-6af74bd49fb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:01.309914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde81d6-2f19-4222-938f-6af74bd49fb6 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:01.310201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde81d6-2f19-4222-938f-6af74bd49fb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:01.310473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde81d6-2f19-4222-938f-6af74bd49fb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:01.318794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde81d6-2f19-4222-938f-6af74bd49fb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:01.320459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde81d6-2f19-4222-938f-6af74bd49fb6 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:01.330493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 599/1198] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:08.652747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc7a0b-d7db-485b-ac03-cbe6e775a8ed None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:08.653317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc7a0b-d7db-485b-ac03-cbe6e775a8ed None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:08.653317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc7a0b-d7db-485b-ac03-cbe6e775a8ed None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:08.654606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 600/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:08.659409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0140c-88de-4c72-acda-b0203ad7adf1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:08.659853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0140c-88de-4c72-acda-b0203ad7adf1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:08.659961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0140c-88de-4c72-acda-b0203ad7adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:08.679615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6fb0140c-88de-4c72-acda-b0203ad7adf1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:08.680877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6fb0140c-88de-4c72-acda-b0203ad7adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:08.688759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 600/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:08.841240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc7a0b-d7db-485b-ac03-cbe6e775a8ed None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:08.855769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc7a0b-d7db-485b-ac03-cbe6e775a8ed None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:08.861078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb1a9-5eb8-4f0d-9040-8db404e91732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:08.861916 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb1a9-5eb8-4f0d-9040-8db404e91732 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:08.862192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb1a9-5eb8-4f0d-9040-8db404e91732 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:08.862462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb1a9-5eb8-4f0d-9040-8db404e91732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:08.870547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb1a9-5eb8-4f0d-9040-8db404e91732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:08.872100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb1a9-5eb8-4f0d-9040-8db404e91732 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:08.881159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 601/1201] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:09.939548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164b62-6223-4364-805f-4ada14a59c92 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.940128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164b62-6223-4364-805f-4ada14a59c92 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.940128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164b62-6223-4364-805f-4ada14a59c92 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:09.941465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 601/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 26 11:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:09.946160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c8ec-48a2-489b-92e6-6e0861ef60f4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:09.946544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c8ec-48a2-489b-92e6-6e0861ef60f4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:09.946701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c8ec-48a2-489b-92e6-6e0861ef60f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:09.966705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f804c8ec-48a2-489b-92e6-6e0861ef60f4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:09.967884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f804c8ec-48a2-489b-92e6-6e0861ef60f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:09.975558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 602/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 26 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:10.130141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164b62-6223-4364-805f-4ada14a59c92 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:10.144416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164b62-6223-4364-805f-4ada14a59c92 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:10.149829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef19c5-c71f-4726-a31d-ff5d9a0045ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:10.150923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef19c5-c71f-4726-a31d-ff5d9a0045ba service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:10.151202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef19c5-c71f-4726-a31d-ff5d9a0045ba service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:10.151470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef19c5-c71f-4726-a31d-ff5d9a0045ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:10.159323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef19c5-c71f-4726-a31d-ff5d9a0045ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:10.160928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef19c5-c71f-4726-a31d-ff5d9a0045ba service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:10.170609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 602/1204] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:14.223750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ebe3-706b-4aed-92bd-4c3b0db771b2 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:14.224282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ebe3-706b-4aed-92bd-4c3b0db771b2 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:14.224282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ebe3-706b-4aed-92bd-4c3b0db771b2 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:14.225645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 603/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:14.231427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b82a9-ea78-4c18-96d8-74f888ae01ab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:14.231849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b82a9-ea78-4c18-96d8-74f888ae01ab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:14.231976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b82a9-ea78-4c18-96d8-74f888ae01ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:14.251912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c93b82a9-ea78-4c18-96d8-74f888ae01ab None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:14.253208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c93b82a9-ea78-4c18-96d8-74f888ae01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:14.261009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 603/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:14.558638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930ebe3-706b-4aed-92bd-4c3b0db771b2 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:14.560326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d930ebe3-706b-4aed-92bd-4c3b0db771b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:14.638707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930ebe3-706b-4aed-92bd-4c3b0db771b2 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:14.642276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c926-8e7d-46c3-85b6-2aceacbba334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:14.642876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c926-8e7d-46c3-85b6-2aceacbba334 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:14.643154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c926-8e7d-46c3-85b6-2aceacbba334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:14.643537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c926-8e7d-46c3-85b6-2aceacbba334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:14.652822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2c926-8e7d-46c3-85b6-2aceacbba334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:14.654259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2c926-8e7d-46c3-85b6-2aceacbba334 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:14.663505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 604/1207] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:16.809238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c742-2423-475d-b9d8-791b2f222117 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:16.809739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c742-2423-475d-b9d8-791b2f222117 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:16.809834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c742-2423-475d-b9d8-791b2f222117 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:16.811134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 604/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:16.816398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c73a7-c984-4c24-9bb8-a5b0878d200a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:16.816865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c73a7-c984-4c24-9bb8-a5b0878d200a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:16.816970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c73a7-c984-4c24-9bb8-a5b0878d200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:16.837111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a16c73a7-c984-4c24-9bb8-a5b0878d200a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:16.838798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a16c73a7-c984-4c24-9bb8-a5b0878d200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:16.846553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 605/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:17.134143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c742-2423-475d-b9d8-791b2f222117 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:17.145528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c742-2423-475d-b9d8-791b2f222117 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:17.149120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2006a4-89ee-4471-b4e6-aa1b52a5c6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:17.149712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2006a4-89ee-4471-b4e6-aa1b52a5c6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:17.149991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2006a4-89ee-4471-b4e6-aa1b52a5c6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:17.150265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2006a4-89ee-4471-b4e6-aa1b52a5c6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:17.159518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2006a4-89ee-4471-b4e6-aa1b52a5c6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:17.160978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2006a4-89ee-4471-b4e6-aa1b52a5c6c8 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:17.170091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 605/1210] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:20.831507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d476-ef03-4d62-9100-b2336f1ae4f4 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:20.832048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d476-ef03-4d62-9100-b2336f1ae4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:20.832048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d476-ef03-4d62-9100-b2336f1ae4f4 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:20.833443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 606/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:20.839105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265c5cf-266c-4633-80f3-21d3a3efa285 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:20.839527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265c5cf-266c-4633-80f3-21d3a3efa285 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:20.839665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265c5cf-266c-4633-80f3-21d3a3efa285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:20.858717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1265c5cf-266c-4633-80f3-21d3a3efa285 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:20.859902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1265c5cf-266c-4633-80f3-21d3a3efa285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:20.867878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 606/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:21.169805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d476-ef03-4d62-9100-b2336f1ae4f4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:21.171492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b5e4d476-ef03-4d62-9100-b2336f1ae4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:21.234680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:21.248782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d476-ef03-4d62-9100-b2336f1ae4f4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:21.252250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28928e6-e969-4b28-b3e5-4c65cd68026e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:21.252869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28928e6-e969-4b28-b3e5-4c65cd68026e service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:21.253142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28928e6-e969-4b28-b3e5-4c65cd68026e service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:21.253408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28928e6-e969-4b28-b3e5-4c65cd68026e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:21.262599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28928e6-e969-4b28-b3e5-4c65cd68026e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:21.264005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28928e6-e969-4b28-b3e5-4c65cd68026e service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:21.273192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 607/1213] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:23.401965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2bc7-ae43-4a0c-b167-a2f9301e53e3 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:23.402603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2bc7-ae43-4a0c-b167-a2f9301e53e3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:23.402603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2bc7-ae43-4a0c-b167-a2f9301e53e3 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:23.403888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 607/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 26 11:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:03:23.409097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac555bb-650c-4066-942e-6c5e96222daa None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:23.409551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac555bb-650c-4066-942e-6c5e96222daa None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:23.409654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac555bb-650c-4066-942e-6c5e96222daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:23.429192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0ac555bb-650c-4066-942e-6c5e96222daa None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:03:23.430369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0ac555bb-650c-4066-942e-6c5e96222daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:23.438141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 608/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 26 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:03:23.737358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2bc7-ae43-4a0c-b167-a2f9301e53e3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:03:23.739022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7c2c2bc7-ae43-4a0c-b167-a2f9301e53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:03:23.747160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:23.753453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2bc7-ae43-4a0c-b167-a2f9301e53e3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:03:23.756948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010e6ab-0e9d-488c-8c10-ff8f6e39fce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:03:23.757585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e6ab-0e9d-488c-8c10-ff8f6e39fce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:03:23.757843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e6ab-0e9d-488c-8c10-ff8f6e39fce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:03:23.758112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e6ab-0e9d-488c-8c10-ff8f6e39fce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:03:23.766776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010e6ab-0e9d-488c-8c10-ff8f6e39fce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:03:23.768194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010e6ab-0e9d-488c-8c10-ff8f6e39fce1 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:03:23.777276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 608/1216] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:03:33.424495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=11 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:03:33.773283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:52.354218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f08fa-20e3-40fd-ab46-011b861898b0 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.355243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f08fa-20e3-40fd-ab46-011b861898b0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.355763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f08fa-20e3-40fd-ab46-011b861898b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.391538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c90f08fa-20e3-40fd-ab46-011b861898b0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.392832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c90f08fa-20e3-40fd-ab46-011b861898b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.398153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be666857-705d-401f-8c9b-f4bd014f57e8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.398681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be666857-705d-401f-8c9b-f4bd014f57e8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.398681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be666857-705d-401f-8c9b-f4bd014f57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.403407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 609/1217] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.410137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec826-02ee-48dc-bb54-6a390f506a8e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.410426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec826-02ee-48dc-bb54-6a390f506a8e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.410703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ec826-02ee-48dc-bb54-6a390f506a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.433154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-be666857-705d-401f-8c9b-f4bd014f57e8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.434370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-be666857-705d-401f-8c9b-f4bd014f57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.440925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3d5ec826-02ee-48dc-bb54-6a390f506a8e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.442361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3d5ec826-02ee-48dc-bb54-6a390f506a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.452385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 609/1218] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.453754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7adb1a-e997-4fa0-a600-9c9ca1f5f447 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.454040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7adb1a-e997-4fa0-a600-9c9ca1f5f447 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.454311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7adb1a-e997-4fa0-a600-9c9ca1f5f447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.457355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 610/1219] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:04:52.458456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098312b2-de6f-43da-a7d9-dd0afa97297d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.458741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098312b2-de6f-43da-a7d9-dd0afa97297d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.459014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098312b2-de6f-43da-a7d9-dd0afa97297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.484138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1d7adb1a-e997-4fa0-a600-9c9ca1f5f447 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.485378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1d7adb1a-e997-4fa0-a600-9c9ca1f5f447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.488742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-098312b2-de6f-43da-a7d9-dd0afa97297d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.489919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-098312b2-de6f-43da-a7d9-dd0afa97297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.494923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 610/1220] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.496379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d7ed-29ed-4885-857a-c5fe392aff00 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.496736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d7ed-29ed-4885-857a-c5fe392aff00 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.497015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d7ed-29ed-4885-857a-c5fe392aff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.499154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 611/1221] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.500219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accb7e1-748a-41ad-909c-e4dd13ae073d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.500533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accb7e1-748a-41ad-909c-e4dd13ae073d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.500808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accb7e1-748a-41ad-909c-e4dd13ae073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.517567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5918d7ed-29ed-4885-857a-c5fe392aff00 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.518752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5918d7ed-29ed-4885-857a-c5fe392aff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.520584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1accb7e1-748a-41ad-909c-e4dd13ae073d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.521856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1accb7e1-748a-41ad-909c-e4dd13ae073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.526492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 611/1222] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.527792 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd719-d7b7-4eed-83e5-c0ef6c05e96b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.528076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd719-d7b7-4eed-83e5-c0ef6c05e96b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.528363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd719-d7b7-4eed-83e5-c0ef6c05e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.534716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 612/1223] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.534889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5606727-1d18-4fe4-8477-c9c77d4e4966 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.535112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5606727-1d18-4fe4-8477-c9c77d4e4966 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.535392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5606727-1d18-4fe4-8477-c9c77d4e4966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.548922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-13dbd719-d7b7-4eed-83e5-c0ef6c05e96b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.550104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-13dbd719-d7b7-4eed-83e5-c0ef6c05e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.554630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d5606727-1d18-4fe4-8477-c9c77d4e4966 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.555786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d5606727-1d18-4fe4-8477-c9c77d4e4966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.558406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 612/1224] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.559632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.559909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.560179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.572929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 613/1225] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.574149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0a823-bc9b-4fb1-972b-2a8191f95d1d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.574431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0a823-bc9b-4fb1-972b-2a8191f95d1d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.574703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0a823-bc9b-4fb1-972b-2a8191f95d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.579981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.581188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.588924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 613/1226] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.589822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.593551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7ca0a823-bc9b-4fb1-972b-2a8191f95d1d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.594732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7ca0a823-bc9b-4fb1-972b-2a8191f95d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.599386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48faedf-d475-49e6-a90c-8c9aa904a59b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.602482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 614/1227] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.603695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.603977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.604299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.608413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.609014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.609290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.609558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.610197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.610496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.611582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:04:52.611582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 11:04:52.611582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 11:04:52.612752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e83c0-0b9a-4deb-ba62-c5f93c8bf6d5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.625136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 614/1228] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.625396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.626335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d284f27-1fa2-4a04-a343-55178cbf1eed None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.626593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.626718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d284f27-1fa2-4a04-a343-55178cbf1eed None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.626952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d284f27-1fa2-4a04-a343-55178cbf1eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.634377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 615/1229] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.636182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.646760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2d284f27-1fa2-4a04-a343-55178cbf1eed None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.647121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff90019-4c10-4bbe-8217-530b78fbab19 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.647942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2d284f27-1fa2-4a04-a343-55178cbf1eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.651758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.652364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.652652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.652922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.653550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.653849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.655427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.655702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 615/1230] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.656926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3c6d9-477b-4bc5-acee-d5d2ce0baba1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.657207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3c6d9-477b-4bc5-acee-d5d2ce0baba1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.657476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3c6d9-477b-4bc5-acee-d5d2ce0baba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.676611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 616/1231] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.676611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.676901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-09a3c6d9-477b-4bc5-acee-d5d2ce0baba1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.677673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-09a3c6d9-477b-4bc5-acee-d5d2ce0baba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.682455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aeeaa-4903-4dc2-841d-2e3c4efc94b3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.685897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 616/1232] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.686996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11725671-f891-4490-817f-12425c40db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.687115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.687358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.687574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725671-f891-4490-817f-12425c40db3f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.687677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.687850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725671-f891-4490-817f-12425c40db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.688120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725671-f891-4490-817f-12425c40db3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.688815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11725671-f891-4490-817f-12425c40db3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.689115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11725671-f891-4490-817f-12425c40db3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.690766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11725671-f891-4490-817f-12425c40db3f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.710047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 617/1233] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.710047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.710047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.710047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.710507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.710507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.717709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 617/1234] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.718530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.726295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:52.727475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:52.727622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beaded-ae11-49d5-a1d5-3f3825ce331e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.732597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.733170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.733444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.733707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.734315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.735813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 618/1235] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:52.736187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.736847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.746273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd5ba-aaae-4b55-9f6b-080aceae864d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.750832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.751414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.751693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.751965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.752630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.752930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.754496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.767683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 619/1236] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.768493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.780811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab1dc-2d5c-4af4-ac98-7251b2b3c0a9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.783627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 618/1237] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:52.784578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.785894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.786487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.786772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.787041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.787670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.787970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.789579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.802860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 620/1238] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.803673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.813091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1438-1eee-481b-a71a-e3a9c0a49391 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.850143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894d2bd-9ac2-4d4c-8948-7982afd985f9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.855401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.855974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.856232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.856515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.857132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.859016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.868467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.869099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.869376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.869642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.870269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.870569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.872177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.884259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 621/1239] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.885619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.889236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 619/1240] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:52.889236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.895279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58576c20-3c59-4a02-92b8-6372157eef08 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.939006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:52.939596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:52.953809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.954532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.954813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.955084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.955343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556ff4d-5a0d-4734-976a-ce5ac0baa699 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.955707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.956741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:04:52.956741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 11:04:52.956741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 11:04:52.957929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.960069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:52.960690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:52.960971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:52.961255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:52.961889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:52.962188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:52.964556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:52.977524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:52.978851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:52.987761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 622/1242] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:52.989238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855ba87-d0a6-415d-8d8b-af57c2b7edf7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:52.989487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.044631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.045267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.045542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.045976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.046622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:04:53.047448 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.049076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.050455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71747c-509e-4315-9178-af8ccab67aff admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.055111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.055712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.055985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.056252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.056947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.058835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.060910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 621/1243] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:04:53.061692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.070951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1156-1bdc-498c-8a68-278dfb41cbbb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.076442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.077021 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.077298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.077567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.078170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.079164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:04:53.079164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 11:04:53.079164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 11:04:53.080370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.095813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 623/1244] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:52 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.097263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.108813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 622/1245] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.109668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.119436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228f44-dd15-47b2-9218-a6707e8fc5c7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.162145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45170-ccf4-4f1b-a01c-bd686c468a36 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.167662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.168492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.168780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.169156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.169785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.171693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.176126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.176764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.177040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.177304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.177917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.180267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.200535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 624/1246] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.201433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.206637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 623/1247] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.207580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.217863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722bdd6-415f-4f0d-84e6-15208a2cbc05 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.247660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:53.264426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:53.272568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d719-f026-4409-8778-b9319bf53293 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.278659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.279273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.279386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.279552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.279823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.279919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.280179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.280490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.280610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.281145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.282401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.283039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.310701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 625/1248] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.314040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 624/1249] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.314641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.314896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.374897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78f9d-283b-4450-a4af-6f1c3e6bc0f7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.376420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bec9ec-7975-4c30-9b3c-07f701d4d072 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.379385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.379990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.380432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.380999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.381233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.381807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.381925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.382142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.382412 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.383027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.383716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.385021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.407075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 626/1250] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.407857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.410828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 625/1251] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.411650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.419066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd46bd-4a4a-479b-a4fa-acc5a1388ef8 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.472402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a046de-2b58-4a3c-b66c-491394b48593 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.474409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.475012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.475296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.475568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.476205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.476977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.477596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.477870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.478139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.478819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.479313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.481385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.492593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 626/1252] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.493909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.502676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 627/1253] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.503490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.504358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e69cb-45fb-46d4-89fb-dd920b71cfc6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.508964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.509557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.509879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.510171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.510813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.512762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.513057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57405ae2-ef51-4776-a036-8e7d6272c8c1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.517595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.518190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.518467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.518739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.519375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.520990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.532878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 628/1254] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.533746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.534775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 627/1255] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.535573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.545456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54351259-7534-42ff-91d7-689f6fdc7383 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.546773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c10e-7d49-46fd-b685-a2b65e227c4b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.550064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.550636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.550942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.551243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.551476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.551853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.552052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.552328 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.552621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.553223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.553885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.555075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.575449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 628/1256] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 294 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.575449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.579836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 629/1257] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.580708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.588541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa028a-790d-4aba-afe5-b3024ede091e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.590698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67a5ac-f8cd-4231-a84d-044629854aa0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.593018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.593596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.593909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.594138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.594757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.595541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.596182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.596310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.596621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.596988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.597661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.599597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.606516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 629/1258] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.607352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.617954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492d51-797c-4b51-bd75-053b39a1fc26 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.625317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 630/1259] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:53 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:53.625465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.625579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.625689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.625689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.625689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.625689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.626264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.628169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:53.628634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:53.634054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566da4-204e-4730-8a34-7940ed33bdeb admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.639827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 630/1260] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.640791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.643766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.644420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.644700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.644966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.645626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.647188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.651389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fba907-55dc-41ad-9389-424bcf370c45 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.656048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.656728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.657076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.657440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.658140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.661374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 631/1261] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.661374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.661602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.671211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2c74f-967a-42f7-9c96-6ada58c4ef8d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.672913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 631/1262] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.676069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.676692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.676840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.676962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.677223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.677844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.679412 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.686065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051635e-61af-467c-b1ea-03a6f8326524 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.689389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 632/1263] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.690026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.690731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.691312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.691581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.691880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.692738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.694298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.699754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689d644-80cb-43a3-8a42-2e7a46875a4f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.704278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.704976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.705257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.705354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 632/1264] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.705549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.706067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.706225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.707778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.716358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2147cd-593e-4189-a1be-cb14d5fe9e02 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.718483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 633/1265] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.719384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.721827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.722431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.722729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.723131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.723752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.725374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.728864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb49d0-68ef-4070-8721-63b32ce5b90b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.733610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.734181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.734481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.734755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.735369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.735471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 633/1266] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.736208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.737234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.745827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827572a-32c6-448d-81ec-e75c79ece8a6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.751809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 634/1267] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.751809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.752035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.752035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.752035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.752035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] PATH_INFO: `/v3/projects/5f36d8ee946c4a9dbc748a3c7599c1ad/users/da45d94c5ee04e8188771180afcd5921/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.758840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea024b-f217-4193-ad1c-f5ff82a1524c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.763883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.764472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.764751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.765025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.765642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.766596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f36d8ee946c4a9dbc748a3c7599c1ad, user_id=da45d94c5ee04e8188771180afcd5921, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.767191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.769254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.778158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 635/1268] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.779694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.784080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 634/1269] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:53 2022] PUT /identity/v3/projects/5f36d8ee946c4a9dbc748a3c7599c1ad/users/da45d94c5ee04e8188771180afcd5921/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:53.784951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.798620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd2bf6-1d55-4a60-ba85-957c54aea5ef admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.846379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d57d-c862-4772-9a37-09355a5ff0da admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.850935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.851541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.851816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.852085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.852745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.854906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.855066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.855557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.855832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.856163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] PATH_INFO: `/v3/projects/268597ccb0ed443d99018d285742a04e/users/d26cf2fdfb9e4eaaae2467fa760343a7/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.868032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 635/1270] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.868032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.873074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=268597ccb0ed443d99018d285742a04e, user_id=d26cf2fdfb9e4eaaae2467fa760343a7, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.875885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.876373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3646d-bd53-4bbe-bec5-339383e5e8cd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.881455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.882186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.882466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.882735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.883489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.885216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.888804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 636/1271] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:53 2022] PUT /identity/v3/projects/268597ccb0ed443d99018d285742a04e/users/d26cf2fdfb9e4eaaae2467fa760343a7/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:53.889593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.900641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 636/1272] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.900641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.907785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212572-6df8-4fbf-a3e7-8694a7978724 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.949681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174240-028a-4144-84e6-3fc159d8abfd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.954269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.954864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.955270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.955415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.956038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.957642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.966008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27aab2e-50a5-494d-878e-78e892d56c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.966756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aab2e-50a5-494d-878e-78e892d56c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.967122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aab2e-50a5-494d-878e-78e892d56c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.967467 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aab2e-50a5-494d-878e-78e892d56c6f admin admin] PATH_INFO: `/v3/projects/2e8f6f2a0fc54f24926ee16947f626e7/users/3c7b0ec4721c467bb99b9e20540a382c/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.967918 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 637/1273] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.968765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:53.977868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeef33-fa6a-42b9-a583-455c5f23d9d0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:53.982520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de978-a973-4686-a275-8a473115a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:53.983023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de978-a973-4686-a275-8a473115a597 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:53.983300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de978-a973-4686-a275-8a473115a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:53.983569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de978-a973-4686-a275-8a473115a597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:53.984180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de978-a973-4686-a275-8a473115a597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.984287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27aab2e-50a5-494d-878e-78e892d56c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8f6f2a0fc54f24926ee16947f626e7, user_id=3c7b0ec4721c467bb99b9e20540a382c, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:53.985759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de978-a973-4686-a275-8a473115a597 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.987232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27aab2e-50a5-494d-878e-78e892d56c6f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:53.996996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 638/1274] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:53.997991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de978-a973-4686-a275-8a473115a597 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.001486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 637/1275] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:53 2022] PUT /identity/v3/projects/2e8f6f2a0fc54f24926ee16947f626e7/users/3c7b0ec4721c467bb99b9e20540a382c/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:54.002744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.003155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.003429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.016567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de978-a973-4686-a275-8a473115a597 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.023036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.028727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.033770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] MFA Rules not processed for user `da45d94c5ee04e8188771180afcd5921`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.035050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.076069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06e85a-5ff7-4b6a-bde8-d48d84b2440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.076763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e85a-5ff7-4b6a-bde8-d48d84b2440d admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.077043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e85a-5ff7-4b6a-bde8-d48d84b2440d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.077319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e85a-5ff7-4b6a-bde8-d48d84b2440d admin admin] PATH_INFO: `/v3/projects/b92667309fe44a3eb6a42801e815f048/users/37f323e298a14d5780357cea0e0fc39f/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.097168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06e85a-5ff7-4b6a-bde8-d48d84b2440d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92667309fe44a3eb6a42801e815f048, user_id=37f323e298a14d5780357cea0e0fc39f, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.099810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06e85a-5ff7-4b6a-bde8-d48d84b2440d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.102229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 638/1276] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.107608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.114221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 639/1277] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:53 2022] PUT /identity/v3/projects/b92667309fe44a3eb6a42801e815f048/users/37f323e298a14d5780357cea0e0fc39f/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:54.115545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.115831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.116101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.119572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cae0f0-d229-4e18-b13a-fbbd42378085 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.135869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.137042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.177219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.177883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.178164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.178446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] PATH_INFO: `/v3/projects/b7a30090c8f146dfaf2eed19e0937d15/users/59de3dc59be54d0abecd7ac47c18d71e/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.192791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a30090c8f146dfaf2eed19e0937d15, user_id=59de3dc59be54d0abecd7ac47c18d71e, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.194987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 640/1278] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.195575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.195813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.204901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d11c89-1202-46a7-8b1d-53f1ca208659 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.210110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.210758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.211039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.211313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] PATH_INFO: `/v3/projects/412a39628ce84c2c9b771082117280db/users/3a46686f6d2444459088c321683566e1/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.216546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 639/1279] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:54 2022] PUT /identity/v3/projects/b7a30090c8f146dfaf2eed19e0937d15/users/59de3dc59be54d0abecd7ac47c18d71e/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:54.217344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.226821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=412a39628ce84c2c9b771082117280db, user_id=3a46686f6d2444459088c321683566e1, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.230243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.243712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 641/1280] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:54 2022] PUT /identity/v3/projects/412a39628ce84c2c9b771082117280db/users/3a46686f6d2444459088c321683566e1/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:54.244589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.289838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2396-07b9-4d46-bfc3-81701f8ddea1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.308242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436fe88-e793-4f9c-a3f7-68065f49c43b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.313372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879395c-79c2-4293-8491-3db67d8d28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.314027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879395c-79c2-4293-8491-3db67d8d28c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.314308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879395c-79c2-4293-8491-3db67d8d28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.314580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879395c-79c2-4293-8491-3db67d8d28c5 admin admin] PATH_INFO: `/v3/projects/b81f1b65ce694067bc83fe01db22d16b/users/27a81db789a641cdb567e6fbeb669069/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.320004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.329396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879395c-79c2-4293-8491-3db67d8d28c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81f1b65ce694067bc83fe01db22d16b, user_id=27a81db789a641cdb567e6fbeb669069, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.332038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879395c-79c2-4293-8491-3db67d8d28c5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.340493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.347697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 642/1281] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:54 2022] PUT /identity/v3/projects/b81f1b65ce694067bc83fe01db22d16b/users/27a81db789a641cdb567e6fbeb669069/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:54.349270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615de02-ff37-4251-befe-0baec34fbdb8 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.349707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615de02-ff37-4251-befe-0baec34fbdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.350203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615de02-ff37-4251-befe-0baec34fbdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.363170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.363836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.364109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.364421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] PATH_INFO: `/v3/projects/fe6b875f365d406694ae4cdf5da2f1fa/users/942dbf4686f84d9daa91fc33e38f59b8/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.379302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f615de02-ff37-4251-befe-0baec34fbdb8 None None] MFA Rules not processed for user `3c7b0ec4721c467bb99b9e20540a382c`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.379865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6b875f365d406694ae4cdf5da2f1fa, user_id=942dbf4686f84d9daa91fc33e38f59b8, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.380568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f615de02-ff37-4251-befe-0baec34fbdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.382005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.396100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 640/1282] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:54 2022] PUT /identity/v3/projects/fe6b875f365d406694ae4cdf5da2f1fa/users/942dbf4686f84d9daa91fc33e38f59b8/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:54.396853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.448504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 643/1283] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.452118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc783-fa9c-453a-a09d-adf16653aa43 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.452118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc783-fa9c-453a-a09d-adf16653aa43 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.452118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fc783-fa9c-453a-a09d-adf16653aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.464164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829e5a-4c5d-48e4-96c3-cf1fa2fb3f1a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.469681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.470381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.470665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.470944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.471611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.473521 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.477510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-348fc783-fa9c-453a-a09d-adf16653aa43 None None] MFA Rules not processed for user `37f323e298a14d5780357cea0e0fc39f`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.478744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-348fc783-fa9c-453a-a09d-adf16653aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.503762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 641/1284] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:54.503762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.545078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 644/1285] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.546389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5293eec-f3f3-4a0d-b992-2ddef200d698 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.546676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5293eec-f3f3-4a0d-b992-2ddef200d698 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.546948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5293eec-f3f3-4a0d-b992-2ddef200d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.557379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476f44-2a2c-445e-a99f-df47a2f2deca admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.562814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cdecd-380d-4fd3-bd13-2196d06d09e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.563660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cdecd-380d-4fd3-bd13-2196d06d09e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.564001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cdecd-380d-4fd3-bd13-2196d06d09e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.564427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cdecd-380d-4fd3-bd13-2196d06d09e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.574721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c5293eec-f3f3-4a0d-b992-2ddef200d698 None None] MFA Rules not processed for user `59de3dc59be54d0abecd7ac47c18d71e`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.575921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c5293eec-f3f3-4a0d-b992-2ddef200d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.620554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.634015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cdecd-380d-4fd3-bd13-2196d06d09e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.635987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cdecd-380d-4fd3-bd13-2196d06d09e2 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.640850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 645/1286] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.642223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b2b9-b2cf-4d4c-9f31-60a42f501208 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.642511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b2b9-b2cf-4d4c-9f31-60a42f501208 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.642782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b2b9-b2cf-4d4c-9f31-60a42f501208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.646718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 642/1287] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:54.648141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389071bc-2e53-4cbc-a779-4e44cd6b1d32 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.648638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389071bc-2e53-4cbc-a779-4e44cd6b1d32 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.649098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389071bc-2e53-4cbc-a779-4e44cd6b1d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.657062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:54.664681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1767b2b9-b2cf-4d4c-9f31-60a42f501208 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.666682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1767b2b9-b2cf-4d4c-9f31-60a42f501208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.676157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 646/1288] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.678917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.679347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.679720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.690174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-389071bc-2e53-4cbc-a779-4e44cd6b1d32 None None] MFA Rules not processed for user `27a81db789a641cdb567e6fbeb669069`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.691270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-389071bc-2e53-4cbc-a779-4e44cd6b1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.700486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:54.701672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.710561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 647/1289] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.711994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.724438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a674447-a2f7-4bb8-9efe-b8a334ba86e7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.729864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.730559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.731036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.731377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.732976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.735066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.767670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 648/1290] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:54.768576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.771643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 643/1291] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:54.773160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341c4a-368d-4a74-9d1a-73fa8b1f7ccd None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.773542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341c4a-368d-4a74-9d1a-73fa8b1f7ccd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.773953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341c4a-368d-4a74-9d1a-73fa8b1f7ccd None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.780755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 644/1292] 10.222.0.49 () {54 vars in 961 bytes} [Wed Oct 26 11:04:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:54.781718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c341c4a-368d-4a74-9d1a-73fa8b1f7ccd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.853281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a397d4e-a36a-48c3-82f7-13ad6a9e82d6 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.858027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.858796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.859109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.859330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.859938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.862366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.883308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c341c4a-368d-4a74-9d1a-73fa8b1f7ccd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.889214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 649/1293] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:54.890059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.890645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:54.891286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:54.891566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:54.891838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:54.892987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:54.894166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:54.896208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:54.928265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 645/1294] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:04:54 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:54.929445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:54.969715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256d543-45f5-47fc-8164-33d23ab561fd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:54.995531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66888-7ffe-48ed-b7e9-edda4b62fe93 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.015312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.016078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.016392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.016669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.035617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:55.037420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181515c6-8766-4fd9-b42c-944b5d9ce86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.038472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181515c6-8766-4fd9-b42c-944b5d9ce86c service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.039111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181515c6-8766-4fd9-b42c-944b5d9ce86c service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.039607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181515c6-8766-4fd9-b42c-944b5d9ce86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.079275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:55.109935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.111577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.123530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 646/1295] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:55.124674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.133961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc44d-af27-4d37-be94-7b74a23eaf50 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.134805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181515c6-8766-4fd9-b42c-944b5d9ce86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.136789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181515c6-8766-4fd9-b42c-944b5d9ce86c service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.140036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad6f1-4a95-437c-8c67-398d50b1bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.140754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad6f1-4a95-437c-8c67-398d50b1bc42 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.141105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad6f1-4a95-437c-8c67-398d50b1bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.141439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad6f1-4a95-437c-8c67-398d50b1bc42 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.142129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ad6f1-4a95-437c-8c67-398d50b1bc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.144495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ad6f1-4a95-437c-8c67-398d50b1bc42 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.152624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 650/1296] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:55.154398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843d80-6eaa-4cbd-9cc1-7908d25e1879 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.155196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843d80-6eaa-4cbd-9cc1-7908d25e1879 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.155668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843d80-6eaa-4cbd-9cc1-7908d25e1879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.173763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 647/1297] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:55 2022] POST /identity/v3/users => generated 295 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:55.175693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a9bf-0dcf-4cbe-bfcd-61bd2df9044e None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.176425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a9bf-0dcf-4cbe-bfcd-61bd2df9044e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.177414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a9bf-0dcf-4cbe-bfcd-61bd2df9044e None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.179563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 648/1298] 10.222.0.49 () {54 vars in 961 bytes} [Wed Oct 26 11:04:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:55.180993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08a9bf-0dcf-4cbe-bfcd-61bd2df9044e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.197657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08a9bf-0dcf-4cbe-bfcd-61bd2df9044e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.203804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.204894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.205223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.205669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.206514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.208966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.218738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-67843d80-6eaa-4cbd-9cc1-7908d25e1879 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:55.220449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-67843d80-6eaa-4cbd-9cc1-7908d25e1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:55.224209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 649/1299] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:55.225365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.240854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4a6b-0491-4f8a-aa19-22dd8b898902 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.247982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.249025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.249589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.250309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.251295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.253907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.298110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 650/1300] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:04:55 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:04:55.298930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.309404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 651/1301] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Oct 26 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:55.311134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.311612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.312270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.319471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aaa47-923b-433c-8011-5cabea04eb0f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.326628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.327248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.327533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.327805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.328493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.330107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.336501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:55.338338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:55.346477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 651/1302] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:55.347374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.350432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 652/1303] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Oct 26 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:55.351465 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.359939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750a6-426d-4719-8e86-69a94aa50429 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.363856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b114-a224-442e-8762-1d3501ea4c39 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.367353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.368311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.369507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.370009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] PATH_INFO: `/v3/projects/715ec3cdd0564c7aa531458b01abb834/users/d65608cd246d47e4a07b60ff920d5f27/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.370202 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.371303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.371845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.372120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.373067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.376889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.390214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 653/1304] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:55.391230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.397811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715ec3cdd0564c7aa531458b01abb834, user_id=d65608cd246d47e4a07b60ff920d5f27, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.401592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.406965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8961df-c0fe-463c-a7e6-b17ce1633290 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.416845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.418664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.418851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.419098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.428343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 652/1305] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:55 2022] PUT /identity/v3/projects/715ec3cdd0564c7aa531458b01abb834/users/d65608cd246d47e4a07b60ff920d5f27/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:55.429310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.508832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.512221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.515508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ebfec-6081-4932-a782-53675a8652d6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.523163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.523901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.524192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.525507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] PATH_INFO: `/v3/projects/38325dab7e1f4e47906d9af65c6bf165/users/92f7cc5b4a5c477f812c2e3805fbc91f/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.529712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:55.531082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.549108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38325dab7e1f4e47906d9af65c6bf165, user_id=92f7cc5b4a5c477f812c2e3805fbc91f, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.550012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733ac61-bbf8-44b3-a64c-800eb4328b38 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.553405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.572744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 653/1307] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:55 2022] PUT /identity/v3/projects/38325dab7e1f4e47906d9af65c6bf165/users/92f7cc5b4a5c477f812c2e3805fbc91f/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:55.573570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.595693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:55.596897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:55.678872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef57a5-8dde-4413-b736-bf7aef4a0139 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.700217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12462b28-04b5-488f-9810-326241874146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.700459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.700967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12462b28-04b5-488f-9810-326241874146 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.701085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.701387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12462b28-04b5-488f-9810-326241874146 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.701507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.701743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12462b28-04b5-488f-9810-326241874146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.701858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] PATH_INFO: `/v3/projects/31d81b705fe748a294605a6f91e6fc0c/users/7851dfe78e09477cbe249ec607d3b05e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.725761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d81b705fe748a294605a6f91e6fc0c, user_id=7851dfe78e09477cbe249ec607d3b05e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.729243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.764323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 654/1308] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:55 2022] PUT /identity/v3/projects/31d81b705fe748a294605a6f91e6fc0c/users/7851dfe78e09477cbe249ec607d3b05e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:55.765328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.796368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12462b28-04b5-488f-9810-326241874146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.798110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12462b28-04b5-488f-9810-326241874146 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.809832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 655/1309] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:55.811240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12462b28-04b5-488f-9810-326241874146 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.826463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12462b28-04b5-488f-9810-326241874146 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.852471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91695cc-07f3-4fc1-8ebf-a53a1bfd0b8e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.859672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.860399 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.860679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.860949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.861589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.863770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.881927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 655/1310] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:55.883034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.898152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e791a-8f2d-4792-b630-12a5f0fdf85a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.905226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.905856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.906104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.906237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.906403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.906728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.907268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.907591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.907874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.908785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.908918 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.910376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.928019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 656/1311] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:55.929295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.944811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 656/1312] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:04:55.947971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:55.949316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c91e1-6afe-4e05-bb77-2cd7b10b1677 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.956929 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:55.957655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:55.957939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:55.958516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] PATH_INFO: `/v3/projects/715ec3cdd0564c7aa531458b01abb834/users/d65608cd246d47e4a07b60ff920d5f27/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:55.960745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=715ec3cdd0564c7aa531458b01abb834, user_id=d65608cd246d47e4a07b60ff920d5f27, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:55.964754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:55.971735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92f23-348c-4703-90e3-e47c20b2b1cf admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:55.981274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 657/1313] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:55 2022] PUT /identity/v3/projects/715ec3cdd0564c7aa531458b01abb834/users/d65608cd246d47e4a07b60ff920d5f27/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:55.982282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:56.118357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d14ada-25ee-48cb-9a45-0856c4a4b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:56.119865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d14ada-25ee-48cb-9a45-0856c4a4b739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.120145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d14ada-25ee-48cb-9a45-0856c4a4b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.122291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d14ada-25ee-48cb-9a45-0856c4a4b739 admin admin] PATH_INFO: `/v3/projects/31d81b705fe748a294605a6f91e6fc0c/users/7851dfe78e09477cbe249ec607d3b05e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.127962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d14ada-25ee-48cb-9a45-0856c4a4b739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d81b705fe748a294605a6f91e6fc0c, user_id=7851dfe78e09477cbe249ec607d3b05e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:56.129924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede308a5-32d7-4810-8ca4-5011417439ea admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:56.132703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d14ada-25ee-48cb-9a45-0856c4a4b739 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:56.135647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:56.141711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a511-86ed-4dbf-b7df-893cb092353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:56.142396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a511-86ed-4dbf-b7df-893cb092353c admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.143659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a511-86ed-4dbf-b7df-893cb092353c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.143946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a511-86ed-4dbf-b7df-893cb092353c admin admin] PATH_INFO: `/v3/projects/38325dab7e1f4e47906d9af65c6bf165/users/92f7cc5b4a5c477f812c2e3805fbc91f/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.148030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5a511-86ed-4dbf-b7df-893cb092353c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38325dab7e1f4e47906d9af65c6bf165, user_id=92f7cc5b4a5c477f812c2e3805fbc91f, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:56.155638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5a511-86ed-4dbf-b7df-893cb092353c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:56.168767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 657/1314] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:55 2022] PUT /identity/v3/projects/31d81b705fe748a294605a6f91e6fc0c/users/7851dfe78e09477cbe249ec607d3b05e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:56.170513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24826894-3bea-43ef-9eb6-440c790a1098 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.170808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24826894-3bea-43ef-9eb6-440c790a1098 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.171274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24826894-3bea-43ef-9eb6-440c790a1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.185222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 658/1315] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:04:55 2022] PUT /identity/v3/projects/38325dab7e1f4e47906d9af65c6bf165/users/92f7cc5b4a5c477f812c2e3805fbc91f/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:04:56.186820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae84411-d85d-4e6c-9f7e-a4fe38b2244b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.187327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae84411-d85d-4e6c-9f7e-a4fe38b2244b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.187832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae84411-d85d-4e6c-9f7e-a4fe38b2244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.208511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:56.213961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-24826894-3bea-43ef-9eb6-440c790a1098 None None] MFA Rules not processed for user `d65608cd246d47e4a07b60ff920d5f27`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:56.215396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-24826894-3bea-43ef-9eb6-440c790a1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:56.248120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-eae84411-d85d-4e6c-9f7e-a4fe38b2244b None None] MFA Rules not processed for user `7851dfe78e09477cbe249ec607d3b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:56.249526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eae84411-d85d-4e6c-9f7e-a4fe38b2244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:56.305977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 658/1316] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:56.308226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.308579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.308854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.351825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] MFA Rules not processed for user `92f7cc5b4a5c477f812c2e3805fbc91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:56.353507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 659/1317] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:56.354819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448479-45a6-4bec-8c1f-bea228b99acc None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.355103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448479-45a6-4bec-8c1f-bea228b99acc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.355373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448479-45a6-4bec-8c1f-bea228b99acc None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.356757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 660/1318] 10.222.0.49 () {54 vars in 912 bytes} [Wed Oct 26 11:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:56.359589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:56.362779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448479-45a6-4bec-8c1f-bea228b99acc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:56.435776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448479-45a6-4bec-8c1f-bea228b99acc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:56.439694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384554a9-0dd0-4484-9c0c-0fffb27589dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:56.440437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384554a9-0dd0-4484-9c0c-0fffb27589dc service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.440717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384554a9-0dd0-4484-9c0c-0fffb27589dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.440987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384554a9-0dd0-4484-9c0c-0fffb27589dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.456326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384554a9-0dd0-4484-9c0c-0fffb27589dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:56.457990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384554a9-0dd0-4484-9c0c-0fffb27589dc service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:56.471884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 661/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:56.474382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba632-79da-4473-9f40-ed36361acdab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.474798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba632-79da-4473-9f40-ed36361acdab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.475165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba632-79da-4473-9f40-ed36361acdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.492734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 659/1320] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:56.494238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:56.504246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-164ba632-79da-4473-9f40-ed36361acdab None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:56.505553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-164ba632-79da-4473-9f40-ed36361acdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:56.513462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e30c41-e9a2-404a-8322-1e381fe4af34 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:56.525110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedc453-0f6b-4462-bd4d-7049a9f6ab77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:56.526316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedc453-0f6b-4462-bd4d-7049a9f6ab77 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.526316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedc453-0f6b-4462-bd4d-7049a9f6ab77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.526542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedc453-0f6b-4462-bd4d-7049a9f6ab77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.550108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedc453-0f6b-4462-bd4d-7049a9f6ab77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:56.551678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedc453-0f6b-4462-bd4d-7049a9f6ab77 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:56.587017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 660/1321] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:56.588063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8061-baf5-4d2f-b2df-8584037b413a None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.588370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8061-baf5-4d2f-b2df-8584037b413a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.588507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 662/1322] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:04:56.589004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8061-baf5-4d2f-b2df-8584037b413a None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.593968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 912 bytes} [Wed Oct 26 11:04:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:04:56.594946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ba632-79da-4473-9f40-ed36361acdab None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:56.601824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.602112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.602382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.605970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ba632-79da-4473-9f40-ed36361acdab None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:56.614482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:56.615627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.616126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.616712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.646631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:04:56.649111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:04:56.652861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:04:56.678755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 662/1324] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:04:56.715269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:56.717212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:56.735033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 663/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:56.740493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:56.753778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ea981-6643-4054-a8d2-0598590b4638 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:56.760278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:56.761141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:56.761528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:56.762093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:56.789037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:56.791340 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:56.822158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 663/1326] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:04:57.757246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:04:57.775180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503254-11cb-40c1-baba-888b629d659b service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:04:57.799569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871f081-6c2d-47b7-a410-19c23d9a41f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:04:57.800918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f081-6c2d-47b7-a410-19c23d9a41f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:04:57.805037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f081-6c2d-47b7-a410-19c23d9a41f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:04:57.805424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f081-6c2d-47b7-a410-19c23d9a41f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:04:57.834333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871f081-6c2d-47b7-a410-19c23d9a41f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:04:57.835947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871f081-6c2d-47b7-a410-19c23d9a41f7 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:04:57.873379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 664/1327] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:00.385779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:00.482815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:00.575690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2115e-2f12-462a-80c1-b889dcee4192 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:00.600283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:00.600553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:00.601201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:00.604265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] PATH_INFO: `/v3/users/27a81db789a641cdb567e6fbeb669069` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:00.615549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a81db789a641cdb567e6fbeb669069)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:00.615549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: WARNING py.warnings [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:05:00.615549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: warnings.warn(msg) Oct 26 11:05:00.615549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: Oct 26 11:05:00.615549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:00.804588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a81db789a641cdb567e6fbeb669069'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:00.865097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a81db789a641cdb567e6fbeb669069'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:00.865903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a81db789a641cdb567e6fbeb669069'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:00.897438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a81db789a641cdb567e6fbeb669069'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:00.918765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a81db789a641cdb567e6fbeb669069'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:00.930581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 664/1328] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:00 2022] DELETE /identity/v3/users/27a81db789a641cdb567e6fbeb669069 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:00.933242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:00.934069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:00.934735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:00.996179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:00.997908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.015200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:01.021290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.219456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29500eea-74cf-40c7-b4ee-3912bd023c62 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:01.231305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 665/1329] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:01.232266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:01.237654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.241015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:01.241677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:01.241955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:01.242226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] PATH_INFO: `/v3/users/59de3dc59be54d0abecd7ac47c18d71e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:01.245647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=59de3dc59be54d0abecd7ac47c18d71e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:01.257914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:01.436673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59de3dc59be54d0abecd7ac47c18d71e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:01.451040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:01.467945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df2204-09c6-4230-8802-4a5d5d3d4fbd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:01.477373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59de3dc59be54d0abecd7ac47c18d71e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:01.478897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59de3dc59be54d0abecd7ac47c18d71e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:01.483318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:01.483959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:01.484241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:01.485565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:01.490724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.501142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59de3dc59be54d0abecd7ac47c18d71e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:01.535122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59de3dc59be54d0abecd7ac47c18d71e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:01.543699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 665/1330] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:00 2022] DELETE /identity/v3/users/59de3dc59be54d0abecd7ac47c18d71e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:01.544579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:01.550528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.668432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:01.671377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabff3f-9853-4440-9770-607defef41da service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:01.675851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:01.719519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 666/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:01.720265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a6be-93d6-4470-adfc-c0ddc22ccbfa admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:01.733291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:01.733784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:01.734706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:01.744906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:01.745549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:01.745823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:01.746091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:01.753699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.800118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:01.801525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:01.990510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:01.992029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:02.012574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 667/1332] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:02.013101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 666/1333] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:02.151668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:02.168205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e36336-8b8c-4c69-8a39-73a12ccf71b1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:02.180182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb1119-3b6b-4f45-b1a4-b9673a579220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:02.180853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1119-3b6b-4f45-b1a4-b9673a579220 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:02.181690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1119-3b6b-4f45-b1a4-b9673a579220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:02.186885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb1119-3b6b-4f45-b1a4-b9673a579220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:02.204361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb1119-3b6b-4f45-b1a4-b9673a579220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:02.205822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb1119-3b6b-4f45-b1a4-b9673a579220 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:02.233461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:03.383825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:03.386103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:03.428566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf0ed-111c-4f95-8527-0de6aa8b761f service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:03.434421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:03.436567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:03.437067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:03.437516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] PATH_INFO: `/v3/users/da45d94c5ee04e8188771180afcd5921` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:03.438856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da45d94c5ee04e8188771180afcd5921)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:03.441834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:03.582578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da45d94c5ee04e8188771180afcd5921'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:03.647196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da45d94c5ee04e8188771180afcd5921'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:03.654490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da45d94c5ee04e8188771180afcd5921'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:03.677136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da45d94c5ee04e8188771180afcd5921'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:03.685942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:03.705579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da45d94c5ee04e8188771180afcd5921'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:03.731215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 667/1335] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:03 2022] DELETE /identity/v3/users/da45d94c5ee04e8188771180afcd5921 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:03.737531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:03.738012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:03.738096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:03.789543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:03.791362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:03.939143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:03.939143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:03.966109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:04.049112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:04.050612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:04.064531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b786-9325-42c6-aac6-46f3d9dd9996 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:04.077177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:04.078264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.078732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.079365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] PATH_INFO: `/v3/projects/b7a30090c8f146dfaf2eed19e0937d15` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.082997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a30090c8f146dfaf2eed19e0937d15)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:04.084810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 26 11:05:04.084810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 26 11:05:04.084810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: Oct 26 11:05:04.086618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:04.122767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad09242-2113-4da3-b650-2f579e3879d3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:04.139381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:04.140194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.140601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.140978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] PATH_INFO: `/v3/users/37f323e298a14d5780357cea0e0fc39f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.145851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f323e298a14d5780357cea0e0fc39f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:04.148252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:04.241892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a30090c8f146dfaf2eed19e0937d15', 'request_id': 'req-87c942ce-4abb-4b24-beef-eb7e6343ab35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.261891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a30090c8f146dfaf2eed19e0937d15', 'request_id': 'req-87c942ce-4abb-4b24-beef-eb7e6343ab35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.272497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a30090c8f146dfaf2eed19e0937d15', 'request_id': 'req-87c942ce-4abb-4b24-beef-eb7e6343ab35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.294213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f323e298a14d5780357cea0e0fc39f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.324752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f323e298a14d5780357cea0e0fc39f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.325848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f323e298a14d5780357cea0e0fc39f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.334667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] The token cache is being invalidate because project b7a30090c8f146dfaf2eed19e0937d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:04.335220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.336093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.339044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 670/1337] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:04 2022] DELETE /identity/v3/projects/b7a30090c8f146dfaf2eed19e0937d15 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:04.342665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:04.346545 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:04.347882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f323e298a14d5780357cea0e0fc39f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.376160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:04.378853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-24175d1c-6cc3-4f7d-8677-6ec0c7483230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f323e298a14d5780357cea0e0fc39f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.387482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 668/1338] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:03 2022] DELETE /identity/v3/users/37f323e298a14d5780357cea0e0fc39f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:04.392994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.393595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.401181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.465653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:04.470949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:04.503560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c942ce-4abb-4b24-beef-eb7e6343ab35 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:04.583711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:04.585079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:04.586795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:04.620885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:04.658725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:04.662406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.665322 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.667276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] PATH_INFO: `/v3/users/7851dfe78e09477cbe249ec607d3b05e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.669882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7851dfe78e09477cbe249ec607d3b05e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:04.672466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:04.694244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4e23d-6e99-446e-8c43-5c124b0a5c55 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:04.705814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:04.706990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.707491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.707981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.713511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:04.734321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:04.737723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:04.763258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 670/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:04.766452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:04.772086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:04.801326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7851dfe78e09477cbe249ec607d3b05e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.804630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670684-5ece-4cc9-8ad8-9b4607a2d198 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:04.816175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ab76-9f72-48ff-986f-64b867a81977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:04.819173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ab76-9f72-48ff-986f-64b867a81977 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.819596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ab76-9f72-48ff-986f-64b867a81977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.821293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ab76-9f72-48ff-986f-64b867a81977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.850654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7851dfe78e09477cbe249ec607d3b05e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.851945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ab76-9f72-48ff-986f-64b867a81977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:04.852078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7851dfe78e09477cbe249ec607d3b05e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.853790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ab76-9f72-48ff-986f-64b867a81977 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:04.864413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7851dfe78e09477cbe249ec607d3b05e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.872916 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 671/1341] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:04.891729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7851dfe78e09477cbe249ec607d3b05e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:04.898726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d113-3f1c-4669-a086-2a4afd720127 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:04.899043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d113-3f1c-4669-a086-2a4afd720127 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:04.899324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d113-3f1c-4669-a086-2a4afd720127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:04.917639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 671/1342] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:04 2022] DELETE /identity/v3/users/7851dfe78e09477cbe249ec607d3b05e => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:04.920669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:04.927869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.022117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6cf4d113-3f1c-4669-a086-2a4afd720127 None None] MFA Rules not processed for user `942dbf4686f84d9daa91fc33e38f59b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:05.023380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6cf4d113-3f1c-4669-a086-2a4afd720127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.068470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:05.133161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606d4e-5f4d-48e5-b989-602d322a5e5d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:05.145689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:05.147586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:05.148041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:05.148342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] PATH_INFO: `/v3/projects/b81f1b65ce694067bc83fe01db22d16b` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:05.153452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81f1b65ce694067bc83fe01db22d16b)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:05.158916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:05.326583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 672/1343] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:05.339648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:05.339947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:05.340229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:05.370895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81f1b65ce694067bc83fe01db22d16b', 'request_id': 'req-92713049-f8d0-4adf-9a9d-5a5e6959025e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:05.388062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81f1b65ce694067bc83fe01db22d16b', 'request_id': 'req-92713049-f8d0-4adf-9a9d-5a5e6959025e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:05.397752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] MFA Rules not processed for user `942dbf4686f84d9daa91fc33e38f59b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:05.399345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81f1b65ce694067bc83fe01db22d16b', 'request_id': 'req-92713049-f8d0-4adf-9a9d-5a5e6959025e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:05.400053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.429668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] The token cache is being invalidate because project b81f1b65ce694067bc83fe01db22d16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:05.431880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:05.433740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-92713049-f8d0-4adf-9a9d-5a5e6959025e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:05.438805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 672/1344] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:04 2022] DELETE /identity/v3/projects/b81f1b65ce694067bc83fe01db22d16b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:05.444841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:05.447323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:05.447737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:05.503727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:05.510073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.598582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 673/1345] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:05.613768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:05.615510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.679020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 673/1346] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:05.679020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:05.683747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.748217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:05.827548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9c70-60c7-44b0-939c-1a9f0d93df6b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:05.836971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:05.839740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:05.840610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:05.841223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] PATH_INFO: `/v3/projects/5f36d8ee946c4a9dbc748a3c7599c1ad` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:05.844007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f36d8ee946c4a9dbc748a3c7599c1ad)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:05.848814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:05.913066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:05.923710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05318027-853d-454f-8a54-3bc896c2b160 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:05.935585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:05.936214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:05.936555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:05.936825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:05.939612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:05.973662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f36d8ee946c4a9dbc748a3c7599c1ad', 'request_id': 'req-6a0a25c4-bfcb-405a-947b-06662d00f381'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:05.979846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:05.984042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497205de-f90a-4687-a0e5-5bf97099a7f3 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:05.992490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f36d8ee946c4a9dbc748a3c7599c1ad', 'request_id': 'req-6a0a25c4-bfcb-405a-947b-06662d00f381'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.000940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f36d8ee946c4a9dbc748a3c7599c1ad', 'request_id': 'req-6a0a25c4-bfcb-405a-947b-06662d00f381'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.020219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 674/1347] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:06.026151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.026442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.026716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.054462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] The token cache is being invalidate because project 5f36d8ee946c4a9dbc748a3c7599c1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:06.054762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.059909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.065752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 674/1348] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:05 2022] DELETE /identity/v3/projects/5f36d8ee946c4a9dbc748a3c7599c1ad => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:06.069375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:06.073098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.107968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:06.109222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.308807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a25c4-bfcb-405a-947b-06662d00f381 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:06.310763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 675/1349] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:06.311765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:06.318131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.325944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:06.326614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.326962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.327239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] PATH_INFO: `/v3/users/d65608cd246d47e4a07b60ff920d5f27` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.328449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65608cd246d47e4a07b60ff920d5f27)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:06.330382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:06.350074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633ef8d-e573-446a-afc6-2c8b3fc56d9e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:06.355424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:06.356079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.360427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.361148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] PATH_INFO: `/v3/projects/b92667309fe44a3eb6a42801e815f048` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.363510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92667309fe44a3eb6a42801e815f048)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:06.366219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:06.445732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65608cd246d47e4a07b60ff920d5f27'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.477548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65608cd246d47e4a07b60ff920d5f27'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.480401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65608cd246d47e4a07b60ff920d5f27'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.486351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:06.490756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92667309fe44a3eb6a42801e815f048', 'request_id': 'req-d3be2e8d-d2ea-4756-86bf-937f606e845c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.501119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65608cd246d47e4a07b60ff920d5f27'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.510224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92667309fe44a3eb6a42801e815f048', 'request_id': 'req-d3be2e8d-d2ea-4756-86bf-937f606e845c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.514920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65608cd246d47e4a07b60ff920d5f27'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.516770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92667309fe44a3eb6a42801e815f048', 'request_id': 'req-d3be2e8d-d2ea-4756-86bf-937f606e845c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.526387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 675/1350] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:06 2022] DELETE /identity/v3/users/d65608cd246d47e4a07b60ff920d5f27 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:06.527343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:06.532748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.537902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] The token cache is being invalidate because project b92667309fe44a3eb6a42801e815f048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:06.538158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.538795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d3be2e8d-d2ea-4756-86bf-937f606e845c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:06.541168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 676/1351] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:06 2022] DELETE /identity/v3/projects/b92667309fe44a3eb6a42801e815f048 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:06.546500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb7d22-45a0-4130-9cc7-8b4a8a5bf9f5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.546873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb7d22-45a0-4130-9cc7-8b4a8a5bf9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.547257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb7d22-45a0-4130-9cc7-8b4a8a5bf9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.593775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-65fb7d22-45a0-4130-9cc7-8b4a8a5bf9f5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:06.595362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-65fb7d22-45a0-4130-9cc7-8b4a8a5bf9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.674265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1740a4-ba5e-49fc-b212-e364d003fc1c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:06.686454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:06.687728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.688225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.688661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.693448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:06.693753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:06.695407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:06.739585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 676/1352] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:06.743638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:06.747306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.774094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf385f-af03-4f66-8cac-971a4d188721 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:06.792483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 677/1353] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:06.804547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.807520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.808083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.811426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:06.813732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:06.815407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:06.815912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:06.816854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:06.822139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:06.850661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:06.855130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:06.874140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 678/1354] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:06.878345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:06.896657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 677/1355] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:06 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:06.897644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:06.904880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3de2f-5255-428e-b948-9a105b7e9e25 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:06.923513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:07.110044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68909f3b-be63-40aa-a083-43f822afae93 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.125177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa976-7f9c-4a1f-8248-43f9020f6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.125801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa976-7f9c-4a1f-8248-43f9020f6300 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.126199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa976-7f9c-4a1f-8248-43f9020f6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.126395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa976-7f9c-4a1f-8248-43f9020f6300 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.135418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa976-7f9c-4a1f-8248-43f9020f6300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.135418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa976-7f9c-4a1f-8248-43f9020f6300 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.149318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.151005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.151505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.151820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.152446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:07.152756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.154389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.180503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 678/1356] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:06 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:07.185449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 679/1357] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:05:07.185449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.189038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.190513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a88b-0b2f-480d-9241-6ee12e4bc8e6 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.191052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a88b-0b2f-480d-9241-6ee12e4bc8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.201680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a88b-0b2f-480d-9241-6ee12e4bc8e6 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.203469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97a3f7-fb87-439d-ac92-ba850848a377 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.204308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 679/1358] 10.222.0.49 () {54 vars in 912 bytes} [Wed Oct 26 11:05:07 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:05:07.205467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a88b-0b2f-480d-9241-6ee12e4bc8e6 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.214011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.214752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.215103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.215572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] PATH_INFO: `/v3/projects/31d81b705fe748a294605a6f91e6fc0c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.216718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d81b705fe748a294605a6f91e6fc0c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.218778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.227454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a88b-0b2f-480d-9241-6ee12e4bc8e6 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.243948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.246260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.247194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.247733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.252149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.256372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.275477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 680/1359] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:07.276718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.309987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec75d9-2346-4dee-b7a8-87814dcb170c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.315603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d81b705fe748a294605a6f91e6fc0c', 'request_id': 'req-c78dbede-df60-4599-8ba9-2aa099b56bf7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:07.339517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d81b705fe748a294605a6f91e6fc0c', 'request_id': 'req-c78dbede-df60-4599-8ba9-2aa099b56bf7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:07.351673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d81b705fe748a294605a6f91e6fc0c', 'request_id': 'req-c78dbede-df60-4599-8ba9-2aa099b56bf7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:07.379966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] The token cache is being invalidate because project 31d81b705fe748a294605a6f91e6fc0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:07.380384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:07.382623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c78dbede-df60-4599-8ba9-2aa099b56bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:07.385750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 680/1360] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:07 2022] DELETE /identity/v3/projects/31d81b705fe748a294605a6f91e6fc0c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:07.414064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70eb93-dce6-4186-b58d-ce2ecbe69819 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.414384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:07.415946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70eb93-dce6-4186-b58d-ce2ecbe69819 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.416399 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70eb93-dce6-4186-b58d-ce2ecbe69819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.476591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1f70eb93-dce6-4186-b58d-ce2ecbe69819 None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:07.482161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.482787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.483050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.483496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.484824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.486923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.497676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1f70eb93-dce6-4186-b58d-ce2ecbe69819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.547533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 681/1361] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:07 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:07.547533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.550493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.661296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 681/1362] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:07.669690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.670055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.671044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.715012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:07.717010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.755088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee18d7-763b-4cdb-9713-9a4077ca543b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.767836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:07.768134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.769102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.769798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.770288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.771138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.775345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.803335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 682/1363] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:07.808158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.813191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.849115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b115-bd33-43e6-aa45-8ebef69e227c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.865299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.865962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.866467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.867096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.867954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.870811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:07.902956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 682/1364] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:07.904187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.907607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.922203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 683/1365] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:07 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:07.923448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:07.929224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:07.945596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143fd79-2ae6-40a5-b264-5c70e4b14333 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:07.963090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:07.964216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:07.964769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:07.965271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] PATH_INFO: `/v3/projects/715ec3cdd0564c7aa531458b01abb834` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:07.966866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715ec3cdd0564c7aa531458b01abb834)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:07.970779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.071341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847652ed-bd66-4168-a639-5d0f0de430c1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:08.092242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715ec3cdd0564c7aa531458b01abb834', 'request_id': 'req-f760ba63-fc40-49f4-8cc1-5dc646db5f42'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:08.105479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715ec3cdd0564c7aa531458b01abb834', 'request_id': 'req-f760ba63-fc40-49f4-8cc1-5dc646db5f42'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:08.118663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715ec3cdd0564c7aa531458b01abb834', 'request_id': 'req-f760ba63-fc40-49f4-8cc1-5dc646db5f42'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:08.179640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] The token cache is being invalidate because project 715ec3cdd0564c7aa531458b01abb834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:08.180253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:08.192090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:08.198649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 683/1366] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:07 2022] DELETE /identity/v3/projects/715ec3cdd0564c7aa531458b01abb834 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:08.199685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:08.201460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.228389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:08.229033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.229312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.229580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.236585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.256573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:08.261344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f9e6-26c2-486b-b795-61322833f19c service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.272248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:08.304084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 684/1367] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:08.307164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ba63-fc40-49f4-8cc1-5dc646db5f42 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:08.307838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.309189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.309654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.322401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108acc-4906-44bd-a624-a5ca1480bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:08.323437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108acc-4906-44bd-a624-a5ca1480bf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.323437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108acc-4906-44bd-a624-a5ca1480bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.323669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108acc-4906-44bd-a624-a5ca1480bf35 admin admin] PATH_INFO: `/v3/projects/3965e8b968bc4d87844b3840edd30f8e/users/2dd29cbe31764fe8abe3692a6efa7f7e/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.354676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4108acc-4906-44bd-a624-a5ca1480bf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3965e8b968bc4d87844b3840edd30f8e, user_id=2dd29cbe31764fe8abe3692a6efa7f7e, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:08.359595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4108acc-4906-44bd-a624-a5ca1480bf35 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.371132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:08.375458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.395013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 685/1368] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:08.396207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:08.408358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.427985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 684/1369] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:08 2022] PUT /identity/v3/projects/3965e8b968bc4d87844b3840edd30f8e/users/2dd29cbe31764fe8abe3692a6efa7f7e/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:08.429553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.429804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.437902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.441007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c463f-7c3c-4feb-bd4b-768aebbb6022 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:08.489854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:08.500321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.575606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:08.621058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a47e-d313-41fa-80d2-f5ef64e028d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:08.623081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a47e-d313-41fa-80d2-f5ef64e028d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.635392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a47e-d313-41fa-80d2-f5ef64e028d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.636026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a47e-d313-41fa-80d2-f5ef64e028d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.639100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08a47e-d313-41fa-80d2-f5ef64e028d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:08.645454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08a47e-d313-41fa-80d2-f5ef64e028d4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.668665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 685/1370] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:08.675687 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:08.686318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 686/1371] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:08.688732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.689352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.690169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.695389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c10a0-522c-4616-8b66-1b499bd9d644 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:08.709111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:08.709754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.710037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.710312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.710979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:08.711282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:08.713003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6ccd-16cf-49a4-911b-d66d3e8a6d45 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.762094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 686/1372] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:08.763559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.763842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.764119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.794872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] MFA Rules not processed for user `2dd29cbe31764fe8abe3692a6efa7f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:08.797230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.811593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:08.812857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:08.838806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 687/1373] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:08.839934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:08.858164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08a5a-a42a-4ed3-9bff-3a8975caa261 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:08.872838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:08.874274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.874869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.875347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.876213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:08.886381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.903681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 688/1374] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:08.904624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:08.925161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a81166-89cd-4720-b16f-d62c0ffdda68 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:08.944733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:08.945660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:08.947261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:08.947722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:08.948752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:08.950761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:08.995777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 687/1375] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:08.996489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.002250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 689/1376] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:08 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:09.002250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.020616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98763-cab9-4897-9e2c-460b7e8c7ceb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:09.189458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:09.190383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:09.190910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cabd9-c99c-4f8f-a6ac-15169bc3f516 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:09.191941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:09.193048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:09.196124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:09.197835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:09.200540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:09.201667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:09.201945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:09.202220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] PATH_INFO: `/v3/projects/2eec087a4db940518e9b102d988053b3/users/6874c259cb124525a7717197f0cb57c7/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:09.204382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:09.230649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eec087a4db940518e9b102d988053b3, user_id=6874c259cb124525a7717197f0cb57c7, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:09.232433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 688/1377] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:09.233473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.240699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:09.255034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968612ef-3cb6-4126-a34f-d08ef019e585 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:09.269846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:09.271033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:09.271619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:09.272291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:09.273106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:09.276472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:09.284014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 690/1378] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:08 2022] PUT /identity/v3/projects/2eec087a4db940518e9b102d988053b3/users/6874c259cb124525a7717197f0cb57c7/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:09.286081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.297931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:09.321250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:09.357132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 689/1379] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:09 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:09.358106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.382352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6a9b2-2922-4c07-88ed-937424891626 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:09.508561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99c71f-d083-4a8c-a201-83a2320599a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:09.510026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:09.512520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99c71f-d083-4a8c-a201-83a2320599a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:09.512839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99c71f-d083-4a8c-a201-83a2320599a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:09.513070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99c71f-d083-4a8c-a201-83a2320599a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:09.513772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99c71f-d083-4a8c-a201-83a2320599a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:09.522928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99c71f-d083-4a8c-a201-83a2320599a1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:09.534749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b147-4c47-43af-88b2-6a8859caa4a2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:09.540739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:09.541351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:09.541627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:09.541901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:09.615282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 690/1380] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:09 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:09.615282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:09.615282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:09.615282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:09.653647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] MFA Rules not processed for user `6874c259cb124525a7717197f0cb57c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:09.655653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:09.669675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:09.675432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:09.701135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 691/1381] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:09.703177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.706126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:09.816720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 691/1382] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:09.816720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:09.876750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c112a34-e21d-4c9f-9e7d-2f6d6f0f51b7 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.043195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.065919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.065919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.065919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.065919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:10.081619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.088060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.096056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9972a5-03c1-4bbb-8b7b-e9eeb72f4fe0 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.104206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d24d-bd22-4acc-a05d-b3b4f65785e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.104885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d24d-bd22-4acc-a05d-b3b4f65785e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.105171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d24d-bd22-4acc-a05d-b3b4f65785e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.105447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d24d-bd22-4acc-a05d-b3b4f65785e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.106104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0d24d-bd22-4acc-a05d-b3b4f65785e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.107878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0d24d-bd22-4acc-a05d-b3b4f65785e6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.124644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 692/1383] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:10.124644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.124644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.124644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.127388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 692/1384] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:10.128494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.139389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:10.160177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367bab-352f-411f-8354-902bb0be2422 service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.180391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] MFA Rules not processed for user `942dbf4686f84d9daa91fc33e38f59b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:10.182075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.182747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:10.183471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.183770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.184050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.184775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.187005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.245707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 693/1385] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:10 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:10.245707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.287693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15fe21-e63f-4f1b-a79e-38c213043536 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.304606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.305580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.306459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.306736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.308903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.312097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.336455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 693/1386] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:10.337449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.348814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:10.388253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b3fb8-95c4-4988-8cb0-a2c2fd22d0d1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.395956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 694/1387] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:10 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:10.399958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.409193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.413447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.413990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.414406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.416892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.418752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.454897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 694/1388] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:10.456142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.479480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740548a-d6e0-4f09-b9d6-e74b312db4bb admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.558180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d60163-e319-44ad-91c3-bfde19d53207 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.570095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.570758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.571040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.571350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] PATH_INFO: `/v3/users/2dd29cbe31764fe8abe3692a6efa7f7e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.572689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd29cbe31764fe8abe3692a6efa7f7e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.574642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.625544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2f061-9573-4d11-9140-ec15b6340158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.626423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2f061-9573-4d11-9140-ec15b6340158 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.626851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2f061-9573-4d11-9140-ec15b6340158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.627264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2f061-9573-4d11-9140-ec15b6340158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.628042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2f061-9573-4d11-9140-ec15b6340158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.629818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2f061-9573-4d11-9140-ec15b6340158 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.656603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 695/1389] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:10.658721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.659545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.674507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.682696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd29cbe31764fe8abe3692a6efa7f7e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:10.700184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd29cbe31764fe8abe3692a6efa7f7e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:10.702461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd29cbe31764fe8abe3692a6efa7f7e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:10.716139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd29cbe31764fe8abe3692a6efa7f7e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:10.741336 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd29cbe31764fe8abe3692a6efa7f7e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:10.753379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 695/1390] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:10 2022] DELETE /identity/v3/users/2dd29cbe31764fe8abe3692a6efa7f7e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:10.755464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.756388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] MFA Rules not processed for user `3a46686f6d2444459088c321683566e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:10.759961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:10.761781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:10.864016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4fb6-d4cd-4b9d-af65-4ad4dfbd143b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.871998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.874579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.875035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.875788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.876543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.881864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.918740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 696/1391] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:10.919874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.922199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:10.945484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a8216-3edf-4776-bb4c-fb37710b2129 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.951616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:10.952409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8f1fa-7f60-4a50-9824-cc5a40210a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.953051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8f1fa-7f60-4a50-9824-cc5a40210a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:10.953518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8f1fa-7f60-4a50-9824-cc5a40210a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:10.953920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8f1fa-7f60-4a50-9824-cc5a40210a49 admin admin] PATH_INFO: `/v3/projects/05eafde503354510906c1dc3a60111b9/users/c25c76f5b84d4731beb149851ce06092/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:10.973436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 696/1392] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:10 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:10.977279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:10.980058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:10.985797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8f1fa-7f60-4a50-9824-cc5a40210a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eafde503354510906c1dc3a60111b9, user_id=c25c76f5b84d4731beb149851ce06092, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:10.989922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8f1fa-7f60-4a50-9824-cc5a40210a49 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:10.993758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20ad4f-0877-451d-af08-9c3230aa420b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:10.999272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3fbf4-6825-4709-aee6-2af958c9c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:10.999897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3fbf4-6825-4709-aee6-2af958c9c982 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.000173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3fbf4-6825-4709-aee6-2af958c9c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.000479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3fbf4-6825-4709-aee6-2af958c9c982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.001503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3fbf4-6825-4709-aee6-2af958c9c982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:11.002623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:11.003855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3fbf4-6825-4709-aee6-2af958c9c982 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:11.009147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 697/1393] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:10 2022] PUT /identity/v3/projects/05eafde503354510906c1dc3a60111b9/users/c25c76f5b84d4731beb149851ce06092/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:11.010701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bddc8-1d40-40ce-b787-54f271cc611d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.011115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bddc8-1d40-40ce-b787-54f271cc611d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.011574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bddc8-1d40-40ce-b787-54f271cc611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.035876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 697/1394] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:11.037129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.037483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.037702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.060747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c43bddc8-1d40-40ce-b787-54f271cc611d None None] MFA Rules not processed for user `d26cf2fdfb9e4eaaae2467fa760343a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:11.062335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c43bddc8-1d40-40ce-b787-54f271cc611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.083062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:11.083690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.247283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 698/1395] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:11.256164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 698/1396] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:11.257790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:11.258641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1ba00-894c-4653-aaea-7ee6cec950ed None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.261469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.266274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1ba00-894c-4653-aaea-7ee6cec950ed None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.269520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1ba00-894c-4653-aaea-7ee6cec950ed None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.273302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 699/1397] 10.222.0.49 () {54 vars in 912 bytes} [Wed Oct 26 11:05:11 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:05:11.273302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1ba00-894c-4653-aaea-7ee6cec950ed None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:11.300143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1ba00-894c-4653-aaea-7ee6cec950ed None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:11.319747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1877f-1e5b-4fdd-ba58-f2df54108243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:11.320837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1877f-1e5b-4fdd-ba58-f2df54108243 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.321525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1877f-1e5b-4fdd-ba58-f2df54108243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.322707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1877f-1e5b-4fdd-ba58-f2df54108243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.324312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1877f-1e5b-4fdd-ba58-f2df54108243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:11.327154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1877f-1e5b-4fdd-ba58-f2df54108243 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:11.357559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 700/1398] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:11.359861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457f41f-0fff-4207-876a-ffb6b0dd268c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.360252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457f41f-0fff-4207-876a-ffb6b0dd268c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.360672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457f41f-0fff-4207-876a-ffb6b0dd268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.436790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6601d-ec46-4832-a97c-0212d3da9399 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:11.444996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2457f41f-0fff-4207-876a-ffb6b0dd268c None None] MFA Rules not processed for user `c25c76f5b84d4731beb149851ce06092`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:11.447018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2457f41f-0fff-4207-876a-ffb6b0dd268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.451463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:11.452100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.452507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.452776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.546787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:11.548740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:11.568887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 699/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:11.574971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 701/1400] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:11.574971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.574971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.574971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.576723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:11.610774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4826f4-6cef-4ab4-9aa2-3a79adaf81a9 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:11.626147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48606fa-7a07-49be-8654-8d5f2a3d6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:11.627779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48606fa-7a07-49be-8654-8d5f2a3d6e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.630462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48606fa-7a07-49be-8654-8d5f2a3d6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.630576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48606fa-7a07-49be-8654-8d5f2a3d6e88 admin admin] PATH_INFO: `/v3/projects/736aec918c0f43d1b69789d1b21690c6/users/ee4b46ca49b843018fbb74840ae05407/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.637554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] MFA Rules not processed for user `d26cf2fdfb9e4eaaae2467fa760343a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:11.645442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.666198 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 702/1401] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:11.667953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:11.670213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.677874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48606fa-7a07-49be-8654-8d5f2a3d6e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736aec918c0f43d1b69789d1b21690c6, user_id=ee4b46ca49b843018fbb74840ae05407, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:11.689589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48606fa-7a07-49be-8654-8d5f2a3d6e88 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:11.717319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:11.734108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 700/1402] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:11 2022] PUT /identity/v3/projects/736aec918c0f43d1b69789d1b21690c6/users/ee4b46ca49b843018fbb74840ae05407/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:11.737184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:11.737468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:11.739180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:11.850236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:11.857027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:11.904767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848717b-1fb4-429e-a5cd-a28888439b2a None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:11.949475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:11.999199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 701/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:12.000804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:12.069056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:12.070018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:12.070131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:12.070480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:12.214378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff810c34-b75b-4b89-9f8d-488f44748efe None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:12.227072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144542d5-41bd-4ca4-ba6b-0d1855fb75b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:12.227746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144542d5-41bd-4ca4-ba6b-0d1855fb75b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:12.228007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144542d5-41bd-4ca4-ba6b-0d1855fb75b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:12.228278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144542d5-41bd-4ca4-ba6b-0d1855fb75b5 admin admin] PATH_INFO: `/v3/projects/3b422f0d1b754a27851ea3847ee1600c/users/26bb725c30f1466ea0ea0d36e5092d17/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:12.263227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:12.265424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:12.272742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144542d5-41bd-4ca4-ba6b-0d1855fb75b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b422f0d1b754a27851ea3847ee1600c, user_id=26bb725c30f1466ea0ea0d36e5092d17, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:12.281318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144542d5-41bd-4ca4-ba6b-0d1855fb75b5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:12.294117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 703/1404] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:12.295033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:12.314055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613f45-06df-4cd2-b7de-765ddd87e281 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:12.323280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 702/1405] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:11 2022] PUT /identity/v3/projects/3b422f0d1b754a27851ea3847ee1600c/users/26bb725c30f1466ea0ea0d36e5092d17/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:12.325208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:12.327677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:12.329342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:12.434239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] MFA Rules not processed for user `ee4b46ca49b843018fbb74840ae05407`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:12.435363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:12.436259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:12.436640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:12.436923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:12.437697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:12.438673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:12.440534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:12.498590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 704/1406] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:12 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:12.499679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:12.624377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 703/1407] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:12.626304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:12.630383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:12.640264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:12.669012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a4d-f101-4570-8cb4-5895457fea10 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:12.678183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:12.678920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:12.679303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:12.679658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:12.722727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:12.819835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:12.821353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f8ba4-2646-4ab0-b262-40aee5777b99 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:12.823789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:12.843519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 705/1408] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:12.844766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.004105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d71c-a640-4a60-be8d-ad8ac55b9ff6 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.010043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.012771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.013049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.013340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.013619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.022335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.023724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.025476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.029303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.038563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.041481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.059654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 706/1409] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:13.059654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.059885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.076069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca043f-f4d1-491d-b9b4-4bb635adcdf5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.084560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.085709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.086150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.087443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.088072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.091160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.108012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 704/1410] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:13.109183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.145332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ab15-4e2c-4a4c-8931-5cb7c16a7bee service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.162498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.163289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.163552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.163834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.164630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.167158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.172917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 707/1411] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:13 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:13.172917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.199861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3bc08-d7bd-47f1-8b02-501128af16f9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.215541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.216276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.219839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.220164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] PATH_INFO: `/v3/projects/3b422f0d1b754a27851ea3847ee1600c/users/26bb725c30f1466ea0ea0d36e5092d17/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.225879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b422f0d1b754a27851ea3847ee1600c, user_id=26bb725c30f1466ea0ea0d36e5092d17, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.237051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 705/1412] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:13 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:13.237051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.237564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.266836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 708/1413] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:13 2022] PUT /identity/v3/projects/3b422f0d1b754a27851ea3847ee1600c/users/26bb725c30f1466ea0ea0d36e5092d17/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:13.268116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.412297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16765-9e78-4323-92ee-93eea4e24024 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.509502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:13.526890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08500a8-484f-4ac5-95a7-9b18ceedbb32 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.542182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc55466-fd5a-4105-bc0f-682ed5b1c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.544024 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.545047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55466-fd5a-4105-bc0f-682ed5b1c48d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.545047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55466-fd5a-4105-bc0f-682ed5b1c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.545047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc55466-fd5a-4105-bc0f-682ed5b1c48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.545711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.545820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc55466-fd5a-4105-bc0f-682ed5b1c48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.547813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc55466-fd5a-4105-bc0f-682ed5b1c48d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.549900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.550461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.552650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.560832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.561080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 706/1414] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:13.563057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.563057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.563057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.576616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:13.617099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 709/1415] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:13 2022] POST /identity/v3/users => generated 295 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:13.622789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.637473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] MFA Rules not processed for user `26bb725c30f1466ea0ea0d36e5092d17`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:13.641136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:13.649954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e3824-1e21-4d5c-9af8-b5b2835bdaab admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.664573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.665331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.665614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.667422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] PATH_INFO: `/v3/projects/6e26652da9084dca9ac5f28ee3ac8e60/users/c0b3f6dc9eb645e88dd744a7e5286b72/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.698139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e26652da9084dca9ac5f28ee3ac8e60, user_id=c0b3f6dc9eb645e88dd744a7e5286b72, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.703584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.734073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 710/1416] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:13 2022] PUT /identity/v3/projects/6e26652da9084dca9ac5f28ee3ac8e60/users/c0b3f6dc9eb645e88dd744a7e5286b72/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:13.735938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.822023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 707/1417] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:13.824428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.836041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e1762-2f6e-4c06-ab84-0084ea605d02 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.883899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f4659-a7cb-432a-b02f-85ff8fea4cbe admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.897545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.899087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.900595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.900938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.905312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.907158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.913633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc7187-a50b-468a-b40f-ff704a82f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.914544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc7187-a50b-468a-b40f-ff704a82f0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.915535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc7187-a50b-468a-b40f-ff704a82f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.915976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc7187-a50b-468a-b40f-ff704a82f0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.916928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc7187-a50b-468a-b40f-ff704a82f0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:13.919540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc7187-a50b-468a-b40f-ff704a82f0c7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:13.934576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 711/1418] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:13.935759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:13.940423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:13.952695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 708/1419] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:13.957396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.957803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.958151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.980966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ce6f-2794-431b-aa40-60ebd88c5527 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:13.991493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:13.993270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:13.994223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:13.994789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] PATH_INFO: `/v3/projects/3965e8b968bc4d87844b3840edd30f8e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:13.997648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3965e8b968bc4d87844b3840edd30f8e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:14.001555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:14.073447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:14.075085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.120077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3965e8b968bc4d87844b3840edd30f8e', 'request_id': 'req-174a94fd-2a19-434e-a9f5-60810008c0cd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:14.137536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3965e8b968bc4d87844b3840edd30f8e', 'request_id': 'req-174a94fd-2a19-434e-a9f5-60810008c0cd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:14.148203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3965e8b968bc4d87844b3840edd30f8e', 'request_id': 'req-174a94fd-2a19-434e-a9f5-60810008c0cd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:14.179700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] The token cache is being invalidate because project 3965e8b968bc4d87844b3840edd30f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:14.180131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:14.182474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:14.189609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 712/1420] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:13 2022] DELETE /identity/v3/projects/3965e8b968bc4d87844b3840edd30f8e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:14.189609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:14.191653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.260297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:14.283577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 709/1421] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:14.296974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:14.299819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.353597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:14.397263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a94fd-2a19-434e-a9f5-60810008c0cd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:14.402269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:14.403028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:14.403485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:14.404269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:14.406554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.434741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63517e90-8fc2-403c-8290-ea6a7ba3aea6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:14.450301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:14.453599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:14.454051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:14.454470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] PATH_INFO: `/v3/projects/0cbedf0e18c24303876775d0c945197d/users/8e8e11da3b234f78967658df92b37e91/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:14.474028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbedf0e18c24303876775d0c945197d, user_id=8e8e11da3b234f78967658df92b37e91, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:14.477403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:14.501909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:14 2022] PUT /identity/v3/projects/0cbedf0e18c24303876775d0c945197d/users/8e8e11da3b234f78967658df92b37e91/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:14.503243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:14.505963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.579006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:14.587616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:14.595870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cc8e7-17b8-44fa-99dc-ce47d0165a88 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:14.601955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a6ad9-3dc4-42d7-b135-063ad52106f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:14.604270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a6ad9-3dc4-42d7-b135-063ad52106f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:14.604753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a6ad9-3dc4-42d7-b135-063ad52106f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:14.605184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a6ad9-3dc4-42d7-b135-063ad52106f8 admin admin] PATH_INFO: `/v3/projects/6e26652da9084dca9ac5f28ee3ac8e60/users/c0b3f6dc9eb645e88dd744a7e5286b72/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:14.608376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a6ad9-3dc4-42d7-b135-063ad52106f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e26652da9084dca9ac5f28ee3ac8e60, user_id=c0b3f6dc9eb645e88dd744a7e5286b72, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:14.611250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a6ad9-3dc4-42d7-b135-063ad52106f8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:14.626559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 713/1423] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:14.627319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 711/1424] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:14 2022] PUT /identity/v3/projects/6e26652da9084dca9ac5f28ee3ac8e60/users/c0b3f6dc9eb645e88dd744a7e5286b72/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:14.629163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:14.629556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:14.629932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:14.634074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:14.638113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.674814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:14.676967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:14.859949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 712/1425] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:14.872548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:14.906286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce4da-3ed3-4f39-a3fb-257ae1879090 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:14.919425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0168-ecd0-497e-91c2-b8c89005cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:14.922609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0168-ecd0-497e-91c2-b8c89005cb82 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:14.924318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0168-ecd0-497e-91c2-b8c89005cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:14.924644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0168-ecd0-497e-91c2-b8c89005cb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:14.926542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b0168-ecd0-497e-91c2-b8c89005cb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:14.929927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b0168-ecd0-497e-91c2-b8c89005cb82 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:14.968775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71b594-beae-4e5f-820c-7618785de984 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:14.972923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 713/1426] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:14.981122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e909-5af8-48c3-8f80-d4005059806e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:14.981422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e909-5af8-48c3-8f80-d4005059806e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:14.983751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e909-5af8-48c3-8f80-d4005059806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:15.010078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:15.120921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1e59e909-5af8-48c3-8f80-d4005059806e None None] MFA Rules not processed for user `c0b3f6dc9eb645e88dd744a7e5286b72`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:15.122267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1e59e909-5af8-48c3-8f80-d4005059806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:15.233042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:15.243766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:15.245123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:15.245614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:15.281503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:15.387795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:15.389604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:15.406508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 714/1427] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:15.408161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:15.408406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:15.409482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:15.435633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 714/1428] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:05:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:05:15.436895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:15.489565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:15.491143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:15.517314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 715/1429] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:15.518297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:15.537785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:15.554272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba771a6-d2c9-4b6f-9282-cdd29c2e5c0f service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:15.596996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:15.599912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:15.602610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:15.606177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] PATH_INFO: `/v3/projects/0cbedf0e18c24303876775d0c945197d/users/8e8e11da3b234f78967658df92b37e91/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:15.614618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbedf0e18c24303876775d0c945197d, user_id=8e8e11da3b234f78967658df92b37e91, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:15.629680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:15.723759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 715/1430] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:15 2022] PUT /identity/v3/projects/0cbedf0e18c24303876775d0c945197d/users/8e8e11da3b234f78967658df92b37e91/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:15.726936 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:15.898906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ea8f0-e8aa-4e63-8284-67a20b4e8d04 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:16.178423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15887ee5-4692-41bb-a76b-be7e839ad6d9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:16.230826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:16.234797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:16.235166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:16.237004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:16.237004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:16.237004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:16.256502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:16.259381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dad13b-e11a-4785-96af-38b6b71859f1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:16.260238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:16.261531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:16.262975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:16.344932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 716/1431] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 620 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:16.352118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:16.355689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:16.365423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:16.502614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] MFA Rules not processed for user `8e8e11da3b234f78967658df92b37e91`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:16.528643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:16.550071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:16.614146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:16.615652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:16.677963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 716/1432] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 1158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:16.678977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:16.687865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:16.753765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a0cd-7470-431e-9068-bdc535dd6836 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:16.770455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 717/1433] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:16.772930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:16.798973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:16.799818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:16.800098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:16.800398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] PATH_INFO: `/v3/users/6874c259cb124525a7717197f0cb57c7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:16.808646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6874c259cb124525a7717197f0cb57c7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:16.814164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:16.815203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf3f8-397c-45db-8e13-0eb7a7b6c689 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:16.829041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d4ed1-342c-449e-b008-6074eb6c7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:16.830035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d4ed1-342c-449e-b008-6074eb6c7f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:16.831297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d4ed1-342c-449e-b008-6074eb6c7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:16.832891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d4ed1-342c-449e-b008-6074eb6c7f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:16.834700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d4ed1-342c-449e-b008-6074eb6c7f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:16.841892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d4ed1-342c-449e-b008-6074eb6c7f49 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:16.883064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:16.911790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 718/1434] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:16 2022] POST /identity/v3/projects => generated 357 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:16.919016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:16.920757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:16.922017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:17.038280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:17.051881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:17.055093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6874c259cb124525a7717197f0cb57c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:17.127215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6874c259cb124525a7717197f0cb57c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:17.129228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6874c259cb124525a7717197f0cb57c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:17.169690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6874c259cb124525a7717197f0cb57c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:17.203320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6874c259cb124525a7717197f0cb57c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:17.245184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 717/1435] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:16 2022] DELETE /identity/v3/users/6874c259cb124525a7717197f0cb57c7 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:17.248699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:17.250846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:17.300060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 719/1436] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Oct 26 11:05:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:17.302073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:17.307146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:17.548320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33007f-f00c-4f78-95b1-4ffb900b6599 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:17.564834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:17.565521 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:17.568561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:17.568920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:17.576219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:17.680237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aad4c0-cd05-4b30-8a73-b2428ba89930 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:17.823022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e9276-30ab-4f50-a606-4028eb4c5cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:17.823690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e9276-30ab-4f50-a606-4028eb4c5cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:17.825035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e9276-30ab-4f50-a606-4028eb4c5cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:17.825335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e9276-30ab-4f50-a606-4028eb4c5cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:17.825995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e9276-30ab-4f50-a606-4028eb4c5cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:17.828110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e9276-30ab-4f50-a606-4028eb4c5cc6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:17.857329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:17.864526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:17.881800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:17 2022] POST /identity/v3/users => generated 279 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:17.882967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:17.883253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:17.883551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:17.937559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 718/1438] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:17.938713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:17.940316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:17.941726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:17.945102 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:17.956738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 721/1439] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:17.959278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:18.000230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:18.000854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2037-7642-4b0d-b871-5c35775a68a3 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.024693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78cd72-e564-4b24-8b6f-e257dee5bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.025504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78cd72-e564-4b24-8b6f-e257dee5bf80 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.026845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78cd72-e564-4b24-8b6f-e257dee5bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.029529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78cd72-e564-4b24-8b6f-e257dee5bf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.031580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78cd72-e564-4b24-8b6f-e257dee5bf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:18.040162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78cd72-e564-4b24-8b6f-e257dee5bf80 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:18.093033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 722/1440] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:18.094983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.094983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.095161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.189099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] MFA Rules not processed for user `3a46686f6d2444459088c321683566e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:18.197812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:18.211579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d95f7b-1206-4821-8e35-90b2fb38dfb1 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.238636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.242223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.242683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.244839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.281387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:18.285259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:18.299551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:18.325957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 719/1441] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:18.326847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:18.355590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660980ad-29a6-4e9e-b910-fdf9e0829743 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.370156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.370790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.371066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.371344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.397245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:18.402065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:18.421173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 723/1442] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:18.424426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:18.438681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 720/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:18.441131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:18.445181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:18.451658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb59d1-915e-4283-ba39-ff153b51fa60 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.468897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.469534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.469826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.470153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.478344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf952-ef85-4308-8051-4f24d55ab4c4 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.479857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:18.481691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:18.503150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.503767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.504048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.504321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] PATH_INFO: `/v3/users/3c7b0ec4721c467bb99b9e20540a382c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.507286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7b0ec4721c467bb99b9e20540a382c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:18.522041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:18.525943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 724/1444] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:18.527286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:18.534294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:18.692829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7b0ec4721c467bb99b9e20540a382c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:18.721916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7b0ec4721c467bb99b9e20540a382c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:18.724842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7b0ec4721c467bb99b9e20540a382c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:18.742294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7b0ec4721c467bb99b9e20540a382c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:18.764001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50672-3d70-42b5-a633-014d48c1ae9e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.767394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7b0ec4721c467bb99b9e20540a382c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:18.775898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 721/1445] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:18 2022] DELETE /identity/v3/users/3c7b0ec4721c467bb99b9e20540a382c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:18.777145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:18.781058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:18.784416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b3f6dc9eb645e88dd744a7e5286b72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26652da9084dca9ac5f28ee3ac8e60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.784416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.784416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.784758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.786079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:18.787124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:18.789810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e991a-fcfa-4830-a396-90ab31c4047e tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:18.826539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 725/1446] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:18.831910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.838110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.838671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:18.896701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:18.899710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:18.970906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc428f3-7f13-4a10-96f9-0432e1d62e20 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:18.996488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f62887-c198-4ee8-8480-00cacd7ced04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:18.997298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62887-c198-4ee8-8480-00cacd7ced04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:18.997688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62887-c198-4ee8-8480-00cacd7ced04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:18.998056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62887-c198-4ee8-8480-00cacd7ced04 admin admin] PATH_INFO: `/v3/projects/5a96dd1926884f0eb079b72930bfa0d8/users/3e4975e3a3a64aae92dcb75ab2efaf9f/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:19.030181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f62887-c198-4ee8-8480-00cacd7ced04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a96dd1926884f0eb079b72930bfa0d8, user_id=3e4975e3a3a64aae92dcb75ab2efaf9f, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:19.037276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f62887-c198-4ee8-8480-00cacd7ced04 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:19.062326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 726/1447] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:19.063432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:19.064992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:19.078563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:19.104374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 722/1448] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:18 2022] PUT /identity/v3/projects/5a96dd1926884f0eb079b72930bfa0d8/users/3e4975e3a3a64aae92dcb75ab2efaf9f/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:19.109022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:19.109600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:19.110775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:19.171725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] MFA Rules not processed for user `3e4975e3a3a64aae92dcb75ab2efaf9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:19.175829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:19.242248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:19.257037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17bd71-0531-4686-963f-963778f4aa13 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:19.387337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 723/1449] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:19.391163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:19.400211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b3f6dc9eb645e88dd744a7e5286b72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26652da9084dca9ac5f28ee3ac8e60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:19.401332 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:19.401940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:19.402324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:19.403094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:19.407727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:19.407892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:19.462984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 727/1450] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:19 2022] POST /identity/v3/projects => generated 353 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:19.466363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:19.619752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759048c7-9424-4750-8b7b-7d434492e311 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:19.621324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f180-03f9-42c2-bd7a-e3f432bf90c4 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:19.629018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:19.629953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:19.630581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:19.630966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:19.631990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:19.634830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:19.705560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 728/1451] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:19 2022] POST /identity/v3/projects => generated 357 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:19.706709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:19.795511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:19.796147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:19.796450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:19.796731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:19.828256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:19.832657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:19.867008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 724/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:19.868068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:19.898459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bb5ab-c521-4732-b00a-d608ba4a27c9 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:19.913109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48982-a885-4601-8732-9827e85e39c5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:19.931254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b3f6dc9eb645e88dd744a7e5286b72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26652da9084dca9ac5f28ee3ac8e60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:19.931892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:19.932178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:19.932519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:19.933177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:19.933563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:19.935564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:19.974444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 729/1453] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:19.995479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:20.028261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.028903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.029186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.029934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.030898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.033232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.056625 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:20.071690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3699-0b73-4257-8f78-e724c3572776 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:20.096807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 725/1454] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:19 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:20.097230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b3f6dc9eb645e88dd744a7e5286b72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e26652da9084dca9ac5f28ee3ac8e60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.098456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:20.099119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.099307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.099886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] PATH_INFO: `/v3/projects/6d41b161158c4af0a46d50b56d5ac770` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.110752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d41b161158c4af0a46d50b56d5ac770)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.113378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.120548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:20.129829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c8ece-dfe0-41f3-9a18-22fcf1f7a0cf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:20.147214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.147836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.148125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.149854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.171419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.177762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.199343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 726/1455] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:20.200360 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:20.213288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:20.253402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d41b161158c4af0a46d50b56d5ac770', 'request_id': 'req-630bad8d-091b-4ccd-a6f8-187c887c8f60'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:20.268641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d41b161158c4af0a46d50b56d5ac770', 'request_id': 'req-630bad8d-091b-4ccd-a6f8-187c887c8f60'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:20.279522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d41b161158c4af0a46d50b56d5ac770', 'request_id': 'req-630bad8d-091b-4ccd-a6f8-187c887c8f60'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:20.310918 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] The token cache is being invalidate because project 6d41b161158c4af0a46d50b56d5ac770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:20.312171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:20.313131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:20.319364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 730/1456] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:20 2022] DELETE /identity/v3/projects/6d41b161158c4af0a46d50b56d5ac770 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:20.320793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:20.323056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:20.329278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01eb2-7af2-4d92-a9ce-dce6a0f2edd3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:20.479762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bad8d-091b-4ccd-a6f8-187c887c8f60 tempest-VolumeQuotaClassesTest-1733696919 tempest-VolumeQuotaClassesTest-1733696919-project-admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:20.493680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.494981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.494981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.497803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] PATH_INFO: `/v3/projects/8cbe2c6af48c43e2bf8853384804a313/users/d800e73b19994405ab77eacd76480f5e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.554315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbe2c6af48c43e2bf8853384804a313, user_id=d800e73b19994405ab77eacd76480f5e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.562343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.565658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.566541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.567100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.567376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.577620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:20.618940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 731/1457] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:20 2022] PUT /identity/v3/projects/8cbe2c6af48c43e2bf8853384804a313/users/d800e73b19994405ab77eacd76480f5e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:20.621792 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:20.624845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:20.803400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.804879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.838464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622a60-47ff-4180-9bcc-12e182410639 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:20.840634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 727/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:20.841343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:20.853565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.854307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.857338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.857691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] PATH_INFO: `/v3/projects/2eec087a4db940518e9b102d988053b3` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.864713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eec087a4db940518e9b102d988053b3)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.872562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.875961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e3519-194e-48bb-a3d7-98efdd469803 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:20.901314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:20.901947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:20.902223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:20.902494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:20.903139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:20.904784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:20.947920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:20.968615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 728/1459] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:20.972774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:21.021332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c54ae-aaed-46cb-8f64-307137930d9d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:21.052654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949a923-ac58-473d-8a18-a66e89ca8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:21.053341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a923-ac58-473d-8a18-a66e89ca8c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:21.053681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a923-ac58-473d-8a18-a66e89ca8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:21.061204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a923-ac58-473d-8a18-a66e89ca8c44 admin admin] PATH_INFO: `/v3/projects/8cbe2c6af48c43e2bf8853384804a313/users/d800e73b19994405ab77eacd76480f5e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:21.071703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a923-ac58-473d-8a18-a66e89ca8c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbe2c6af48c43e2bf8853384804a313, user_id=d800e73b19994405ab77eacd76480f5e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:21.086213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a923-ac58-473d-8a18-a66e89ca8c44 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:21.109466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eec087a4db940518e9b102d988053b3', 'request_id': 'req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.152211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eec087a4db940518e9b102d988053b3', 'request_id': 'req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.169056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 729/1460] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:20 2022] PUT /identity/v3/projects/8cbe2c6af48c43e2bf8853384804a313/users/d800e73b19994405ab77eacd76480f5e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:21.171358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:21.171651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:21.172109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:21.182050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eec087a4db940518e9b102d988053b3', 'request_id': 'req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.237316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] The token cache is being invalidate because project 2eec087a4db940518e9b102d988053b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:21.237611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.238394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:21.248363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.257857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 732/1461] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:20 2022] DELETE /identity/v3/projects/2eec087a4db940518e9b102d988053b3 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:21.270192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:21.272975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:21.318593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] MFA Rules not processed for user `d800e73b19994405ab77eacd76480f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:21.319803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:21.469849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 730/1462] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:21.471085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:21.484780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:21.580106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223c2c-bbb2-497d-8d9c-dc1b8ae80cc5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:21.594387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:21.595047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:21.595797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a4f72-b074-47d1-974a-31f31f9b018a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:21.596794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:21.597205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] PATH_INFO: `/v3/users/c25c76f5b84d4731beb149851ce06092` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:21.599172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25c76f5b84d4731beb149851ce06092)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:21.601862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:21.621388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:21.624494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:21.626309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:21.626741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] PATH_INFO: `/v3/users/26bb725c30f1466ea0ea0d36e5092d17` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:21.629462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bb725c30f1466ea0ea0d36e5092d17)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:21.639336 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:21.765080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25c76f5b84d4731beb149851ce06092'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.834909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bb725c30f1466ea0ea0d36e5092d17'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.865122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25c76f5b84d4731beb149851ce06092'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.869015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25c76f5b84d4731beb149851ce06092'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.930766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bb725c30f1466ea0ea0d36e5092d17'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.934087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25c76f5b84d4731beb149851ce06092'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.936641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bb725c30f1466ea0ea0d36e5092d17'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.976171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25c76f5b84d4731beb149851ce06092'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:21.991446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bb725c30f1466ea0ea0d36e5092d17'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:22.013084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 733/1463] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:21 2022] DELETE /identity/v3/users/c25c76f5b84d4731beb149851ce06092 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:22.017586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:22.022137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3aa44ea5-9822-4328-a75f-77b96c612cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bb725c30f1466ea0ea0d36e5092d17'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:22.027393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:22.088936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 731/1464] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:21 2022] DELETE /identity/v3/users/26bb725c30f1466ea0ea0d36e5092d17 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:22.101337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:22.104951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:22.109600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:22.153823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:22.188431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:22.194242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:22.224598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:22.256559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c6895-5e49-4535-b137-4eb39127bbf7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:22.356427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 732/1465] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:22.375213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:22.377394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:22.379012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:22.380742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:22.384837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:22.400658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:22.403068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:22.551264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb9a2-4309-4481-b85d-3fafdc1e60d7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:22.561907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb9075-f872-4c28-8a21-9eda6d225b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:22.562727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb9075-f872-4c28-8a21-9eda6d225b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:22.563149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb9075-f872-4c28-8a21-9eda6d225b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:22.563672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:22.563786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb9075-f872-4c28-8a21-9eda6d225b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:22.568996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:22.588672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb9075-f872-4c28-8a21-9eda6d225b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:22.591125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb9075-f872-4c28-8a21-9eda6d225b13 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:22.599942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 734/1466] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:22.619256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 733/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:22.758835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:22.761003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:22.786380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc44ea-5483-430f-b72c-788501f7ee43 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:22.802932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:22.806682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:22.807577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:22.810585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:22.816771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:22.991436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:22.993152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe5945-2331-4532-be21-2fd2bd06aa3d service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:23.004879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 735/1468] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:23.056662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa8ab-5723-4caf-a4af-fd25cb343c9d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:23.057224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa8ab-5723-4caf-a4af-fd25cb343c9d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:23.057422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa8ab-5723-4caf-a4af-fd25cb343c9d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:23.059664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 734/1469] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:05:23.083431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:23.084027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:23.084534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:23.133171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:23.135452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:23.235177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:23.413670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa8ab-5723-4caf-a4af-fd25cb343c9d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:23.416248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-975fa8ab-5723-4caf-a4af-fd25cb343c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:23.430895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 736/1470] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:05:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:23.467230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa8ab-5723-4caf-a4af-fd25cb343c9d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:23.483514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:23.483514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:23.483514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:23.483514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] PATH_INFO: `/v3/projects/3b422f0d1b754a27851ea3847ee1600c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:23.485703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b422f0d1b754a27851ea3847ee1600c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:23.489602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:23.494010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:23.495888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:23.522743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587b074-d127-47c1-b50a-a12c3248c660 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:23.537470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:23.538204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:23.538587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:23.539080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] PATH_INFO: `/v3/projects/2e8f6f2a0fc54f24926ee16947f626e7` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:23.541827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8f6f2a0fc54f24926ee16947f626e7)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:23.543907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:23.652250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8f6f2a0fc54f24926ee16947f626e7', 'request_id': 'req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.668877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8f6f2a0fc54f24926ee16947f626e7', 'request_id': 'req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.689016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8f6f2a0fc54f24926ee16947f626e7', 'request_id': 'req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.690249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b422f0d1b754a27851ea3847ee1600c', 'request_id': 'req-5ab61e76-fcab-4609-b209-959a6fa4cf5b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.710130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b422f0d1b754a27851ea3847ee1600c', 'request_id': 'req-5ab61e76-fcab-4609-b209-959a6fa4cf5b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.728587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b422f0d1b754a27851ea3847ee1600c', 'request_id': 'req-5ab61e76-fcab-4609-b209-959a6fa4cf5b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.749615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] The token cache is being invalidate because project 3b422f0d1b754a27851ea3847ee1600c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:23.750080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.751069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] The token cache is being invalidate because project 2e8f6f2a0fc54f24926ee16947f626e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:23.751192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.752112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.754052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 737/1471] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:23 2022] DELETE /identity/v3/projects/2e8f6f2a0fc54f24926ee16947f626e7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:23.754855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:23.756234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:23.764422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:23.766526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:23 2022] DELETE /identity/v3/projects/3b422f0d1b754a27851ea3847ee1600c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:23.770273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:23.777707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:23.874135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce8ff6-bcb9-4eb2-b1cf-1ea05c76d179 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:23.907291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:23.940943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab61e76-fcab-4609-b209-959a6fa4cf5b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:23.947148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:23.947918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:23.948703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:23.948984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] PATH_INFO: `/v3/users/92f7cc5b4a5c477f812c2e3805fbc91f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:23.950319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f7cc5b4a5c477f812c2e3805fbc91f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:23.952455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:23.979278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:24.032994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f7cc5b4a5c477f812c2e3805fbc91f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:24.046889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:24.047816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.048259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.048749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.049376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f7cc5b4a5c477f812c2e3805fbc91f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:24.050427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f7cc5b4a5c477f812c2e3805fbc91f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:24.055480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:24.062908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f7cc5b4a5c477f812c2e3805fbc91f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:24.085066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-77f43f9d-c236-42be-8df0-bf8418f74451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f7cc5b4a5c477f812c2e3805fbc91f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:24.110482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 736/1473] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:23 2022] DELETE /identity/v3/users/92f7cc5b4a5c477f812c2e3805fbc91f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:24.110666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:24.112516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.112804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.113263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f555545-c9b4-47fa-a1ad-9ff62a6765e2 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:24.116623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.141660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 738/1474] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:24.152045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:24.153188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:24.308964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 737/1475] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:24.316950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.317591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.318008 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.363012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:24.367389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:24.392437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 739/1476] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:24.396752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:24.410988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345cb5-1734-42ce-a766-cbf1b91c8afb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:24.424378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:24.425016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.425372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.425623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.426303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:24.426718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:24.432212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:24.460822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 738/1477] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:24.465286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:24.479282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf379ce-9a4b-45bb-8f22-7514c4181c76 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:24.522620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:24.528299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.530700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.531758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.532831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:24.539046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:24.603197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 740/1478] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:24 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:24.607644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:24.626878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fc91-158b-42b5-8676-3f3568ad211a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:24.753298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:24.755674 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:24.769490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:24.838846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:24.839982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.840274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.840692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.841411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:24.845861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:24.898910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 739/1479] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:24 2022] POST /identity/v3/users => generated 281 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:24.898910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:24.901621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:24.949232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2b4b-4912-4824-9497-ea49adee466c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:24.961147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b54e-9558-4906-8482-34359668dd9c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:24.972072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:24.972925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.973311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.973697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] PATH_INFO: `/v3/users/ee4b46ca49b843018fbb74840ae05407` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.974754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:24.975226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4b46ca49b843018fbb74840ae05407)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:24.975414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:24.975701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:24.975975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] PATH_INFO: `/v3/projects/05eafde503354510906c1dc3a60111b9` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:24.977250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eafde503354510906c1dc3a60111b9)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:24.977922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:24.979145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:25.091704 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eafde503354510906c1dc3a60111b9', 'request_id': 'req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.113815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eafde503354510906c1dc3a60111b9', 'request_id': 'req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.120690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eafde503354510906c1dc3a60111b9', 'request_id': 'req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.146871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] The token cache is being invalidate because project 05eafde503354510906c1dc3a60111b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:25.147170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.147846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.153243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 741/1480] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:24 2022] DELETE /identity/v3/projects/05eafde503354510906c1dc3a60111b9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:25.153243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:25.154173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:25.236320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:25.339384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf190e-8c3e-4203-b04d-053ae8eb5e7f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:25.358537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:25.359169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:25.359444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:25.359715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:25.360525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:25.363537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:25.385108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4b46ca49b843018fbb74840ae05407'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.397226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 742/1481] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:25.399629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:25.405609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:25.429334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4b46ca49b843018fbb74840ae05407'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.431103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4b46ca49b843018fbb74840ae05407'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.450278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4b46ca49b843018fbb74840ae05407'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.469433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53080a2-8567-4652-a1bf-325a8236f98e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:25.476521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:25.477449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:25.478177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:25.479258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] PATH_INFO: `/v3/users/c0b3f6dc9eb645e88dd744a7e5286b72` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:25.480729 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b3f6dc9eb645e88dd744a7e5286b72)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:25.483666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:25.488518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4b46ca49b843018fbb74840ae05407'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.499148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 740/1482] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:24 2022] DELETE /identity/v3/users/ee4b46ca49b843018fbb74840ae05407 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:25.502783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:25.506953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:25.603748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b3f6dc9eb645e88dd744a7e5286b72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.636367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b3f6dc9eb645e88dd744a7e5286b72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.638163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b3f6dc9eb645e88dd744a7e5286b72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.651645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b3f6dc9eb645e88dd744a7e5286b72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.671148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-1c919fd2-d15c-4e6c-abb3-a432448c95e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b3f6dc9eb645e88dd744a7e5286b72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:25.686035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:25 2022] DELETE /identity/v3/users/c0b3f6dc9eb645e88dd744a7e5286b72 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:25.687846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:25.688135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:25.690862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:25.697763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8ebfb-fc22-482f-ade7-b39c21037ada admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:25.735914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:25.739909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:25.874968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:25.922604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:25.923519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:25.924854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:25.939442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 744/1484] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:25.942781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:25.943475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:25.948248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:25.978109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 741/1485] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:25.980969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:25.982846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:26.006739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:26.009042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:26.035268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eca622-aaef-4efe-b9f7-3dc71ced7605 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:26.065040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9308b-1985-4022-8531-8dcd450e7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:26.069203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9308b-1985-4022-8531-8dcd450e7896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:26.072019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9308b-1985-4022-8531-8dcd450e7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:26.073081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9308b-1985-4022-8531-8dcd450e7896 admin admin] PATH_INFO: `/v3/projects/b96e6fa497f84d59b92ea5a033aa85ca/users/2f36e27b5dfb40b6847d90c72c00775c/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:26.143080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e68a-7dff-4eef-905b-b500dacb06a0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:26.149676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9308b-1985-4022-8531-8dcd450e7896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96e6fa497f84d59b92ea5a033aa85ca, user_id=2f36e27b5dfb40b6847d90c72c00775c, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:26.158906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9308b-1985-4022-8531-8dcd450e7896 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:26.162056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:26.162685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:26.162962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:26.163229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:26.194718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:26.196241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:26.200756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 745/1486] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:25 2022] PUT /identity/v3/projects/b96e6fa497f84d59b92ea5a033aa85ca/users/2f36e27b5dfb40b6847d90c72c00775c/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:26.212804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:26.213093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:26.213437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:26.225404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 742/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:05:26.260017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:26.281794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] MFA Rules not processed for user `2f36e27b5dfb40b6847d90c72c00775c`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:26.284420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:26.508717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 746/1488] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:26.512068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:26.527451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125947-621c-415f-bde1-2ca4dd8382e4 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:26.651202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:26.651893 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:26.652236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:26.652571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:26.653394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:26.656231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:26.725879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 743/1489] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:26 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:26.730018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:26.761030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639926cd-20a9-4b64-9a0e-82a5cd8bf233 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:26.917479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:26.923772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:26.925238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:26.926591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:26.943029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:26.944806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:26.948943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:26.951264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:26.970620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7253d83-876e-4313-ab2d-18f1b384c9c7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:26.993971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:26.996036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:26.997639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:26.998046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] PATH_INFO: `/v3/projects/38325dab7e1f4e47906d9af65c6bf165` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.002874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38325dab7e1f4e47906d9af65c6bf165)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.005132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:27.028450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 747/1490] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:26 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:27.033578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:27.075582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e443-eaa3-4802-9adc-47eadca43f7c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:27.110284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38325dab7e1f4e47906d9af65c6bf165', 'request_id': 'req-57369643-a122-4074-a83c-be05b9661459'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:27.112429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:27.115301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.115870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.116428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.117436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.121636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:27.124266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38325dab7e1f4e47906d9af65c6bf165', 'request_id': 'req-57369643-a122-4074-a83c-be05b9661459'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:27.130838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38325dab7e1f4e47906d9af65c6bf165', 'request_id': 'req-57369643-a122-4074-a83c-be05b9661459'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:27.145051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 748/1491] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:27.150734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:27.151713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:27.158927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] The token cache is being invalidate because project 38325dab7e1f4e47906d9af65c6bf165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:27.159950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:27.160873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-57369643-a122-4074-a83c-be05b9661459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:27.163040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 744/1492] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:26 2022] DELETE /identity/v3/projects/38325dab7e1f4e47906d9af65c6bf165 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:27.168239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554d05-1385-4299-b101-1a4e9fcd77c8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.168643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554d05-1385-4299-b101-1a4e9fcd77c8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.168995 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554d05-1385-4299-b101-1a4e9fcd77c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.177596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36f39-7784-42dd-95cd-d769c13dcd8c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:27.212037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f2554d05-1385-4299-b101-1a4e9fcd77c8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:27.216027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f2554d05-1385-4299-b101-1a4e9fcd77c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:27.314562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:27.317362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.317913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.319213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] PATH_INFO: `/v3/projects/1e696ab27ee14b8b9c8a0fd4aa98b6ac/users/1693e9df98414a33970a744ecf595514/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.358617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 745/1493] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:27.366890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.367292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.367855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.386780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e696ab27ee14b8b9c8a0fd4aa98b6ac, user_id=1693e9df98414a33970a744ecf595514, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.391968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:27.442193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:27.453004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:27.479837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 749/1494] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:27 2022] PUT /identity/v3/projects/1e696ab27ee14b8b9c8a0fd4aa98b6ac/users/1693e9df98414a33970a744ecf595514/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:27.481648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:27.488471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:27.509515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:27.613068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf55806-841a-496c-9d45-f1cdc03bb793 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:27.623821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:27.626600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.627666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.627666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.628127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.630213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:27.658012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 750/1495] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:27.662296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:27.691331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61944a-6833-47be-ba34-c40822c0c074 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:27.697253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 746/1496] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:27.701784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:27.715407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d9195-27b7-4e91-a278-a5df9dbd4606 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:27.716575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ca346-3957-4bfb-872c-b20d993455fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:27.717432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca346-3957-4bfb-872c-b20d993455fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.717720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca346-3957-4bfb-872c-b20d993455fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.717993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca346-3957-4bfb-872c-b20d993455fa admin admin] PATH_INFO: `/v3/projects/1e696ab27ee14b8b9c8a0fd4aa98b6ac/users/1693e9df98414a33970a744ecf595514/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.720937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ca346-3957-4bfb-872c-b20d993455fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e696ab27ee14b8b9c8a0fd4aa98b6ac, user_id=1693e9df98414a33970a744ecf595514, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.723645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ca346-3957-4bfb-872c-b20d993455fa admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:27.731180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:27.731805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.732085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.732367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.733037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:27.733332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.734959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:27.752207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 751/1497] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:27 2022] PUT /identity/v3/projects/1e696ab27ee14b8b9c8a0fd4aa98b6ac/users/1693e9df98414a33970a744ecf595514/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:27.763647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.763948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.764201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.770890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 747/1498] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:27.775873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:27.795137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ef8c-60dc-4b9e-a32a-798765206976 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:27.832355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] MFA Rules not processed for user `1693e9df98414a33970a744ecf595514`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:27.833679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:27.946599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:27.948917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:27.948917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:27.948917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:27.948917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:27.950651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:28.018762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 752/1499] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:28.028318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:28.029547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:28.051066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 748/1500] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:27 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:28.054571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:28.116810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:28.225569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de77a-537e-46d4-a952-ab1d905afe31 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:28.261875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d78bc-fb5c-4aec-a8c8-d188033dc4e8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:28.276309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:28.276871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:28.277533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:28.277533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:28.279918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:28.287122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:28.296353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:28.368450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:28.369921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:28.370407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:28.370407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:28.377840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 749/1501] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:28 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:28.387524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:28.395549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:28.450083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff44a-600e-4110-853a-7bb084d60c3b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:28.478802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:28.479485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:28.479736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:28.480009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] PATH_INFO: `/v3/projects/6e26652da9084dca9ac5f28ee3ac8e60` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:28.484546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e26652da9084dca9ac5f28ee3ac8e60)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:28.488375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:28.566716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:28.568219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:28.582335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 753/1502] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:28.583431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:28.595887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f17c2-965e-4325-929b-8cdfecc37d7a service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:28.613936 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:28.618341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:28.618596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:28.618875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:28.625484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:28.636255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:28.645769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e26652da9084dca9ac5f28ee3ac8e60', 'request_id': 'req-96ff2e4a-18b7-4215-9102-291dab1622b6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:28.671008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e26652da9084dca9ac5f28ee3ac8e60', 'request_id': 'req-96ff2e4a-18b7-4215-9102-291dab1622b6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:28.696624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 754/1503] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:28.696823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e26652da9084dca9ac5f28ee3ac8e60', 'request_id': 'req-96ff2e4a-18b7-4215-9102-291dab1622b6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:28.698143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:28.734767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f7806-ec55-44b1-9a02-451aab4478db admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:28.754177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] The token cache is being invalidate because project 6e26652da9084dca9ac5f28ee3ac8e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:28.754177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:28.755862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:28.759732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 750/1504] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:28 2022] DELETE /identity/v3/projects/6e26652da9084dca9ac5f28ee3ac8e60 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:28.764312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:28.771005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:28.957519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01288ae6-cf05-4a67-b327-e9296e4e78fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:28.958712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01288ae6-cf05-4a67-b327-e9296e4e78fe admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:28.958985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01288ae6-cf05-4a67-b327-e9296e4e78fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:28.959279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01288ae6-cf05-4a67-b327-e9296e4e78fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:28.960748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01288ae6-cf05-4a67-b327-e9296e4e78fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:28.963713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2e4a-18b7-4215-9102-291dab1622b6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:28.964524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01288ae6-cf05-4a67-b327-e9296e4e78fe admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:28.974050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:28.976248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:28.977866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:28.978113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.005586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.028129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 755/1505] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:29.031092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.031484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.032162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.073689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:29.115021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:29.115021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.115990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.120798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f9441-e621-4c04-ad04-8b061d23cf46 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.129564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 756/1506] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:29.136559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.136559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.152519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 751/1507] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:29.153706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33b65-8bb6-4689-90f9-0ad01cdb2073 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.153914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.154198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.154476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.160441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f39f7-acb7-4bb1-af95-25b24632f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.161392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f39f7-acb7-4bb1-af95-25b24632f071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.161899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f39f7-acb7-4bb1-af95-25b24632f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.162375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f39f7-acb7-4bb1-af95-25b24632f071 admin admin] PATH_INFO: `/v3/projects/507da69b48944695a50dbbb1c2a53c22/users/2322ae0cbbee4712b04b39381385a61c/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.182165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f39f7-acb7-4bb1-af95-25b24632f071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507da69b48944695a50dbbb1c2a53c22, user_id=2322ae0cbbee4712b04b39381385a61c, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.185812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f39f7-acb7-4bb1-af95-25b24632f071 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.204174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:29.207579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.220776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 757/1508] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:29 2022] PUT /identity/v3/projects/507da69b48944695a50dbbb1c2a53c22/users/2322ae0cbbee4712b04b39381385a61c/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:29.224109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.224431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.224715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.275671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] MFA Rules not processed for user `2322ae0cbbee4712b04b39381385a61c`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:29.277015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.313964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:29.483576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 758/1509] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:29.490273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.495188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 752/1510] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:29.497735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.523858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7963b37-fe65-47c3-9d4f-2d8d83bc6a47 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.534003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.536484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.536920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.538516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.540750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.543228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.549733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12504a45-9853-4f45-8e36-e3885a9f9d2e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.567738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.568406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.568686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.568955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.569621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:29.569911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.572171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.597898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 759/1511] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:29.598892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.600707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.607224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 753/1512] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:29.608626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.615623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817dd03-9999-4d77-8fe0-55c749ed80bd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.688010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82bdac-e018-4321-80a2-33667261e0d7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.695547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.696402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.696838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.697305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.698087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.699770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.700373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.700579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.701207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.701852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] PATH_INFO: `/v3/projects/736aec918c0f43d1b69789d1b21690c6` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.703194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=736aec918c0f43d1b69789d1b21690c6)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.705229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.751403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 754/1513] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:29.753162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.807130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736aec918c0f43d1b69789d1b21690c6', 'request_id': 'req-335adf1d-f575-4002-8353-8625220e67f9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:29.815730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736aec918c0f43d1b69789d1b21690c6', 'request_id': 'req-335adf1d-f575-4002-8353-8625220e67f9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:29.824044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:29.824645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736aec918c0f43d1b69789d1b21690c6', 'request_id': 'req-335adf1d-f575-4002-8353-8625220e67f9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:29.844171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e350-0fee-4474-8de5-fc833a2de454 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.845284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] The token cache is being invalidate because project 736aec918c0f43d1b69789d1b21690c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:29.845668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:29.846392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:29.851648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 760/1514] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:29 2022] DELETE /identity/v3/projects/736aec918c0f43d1b69789d1b21690c6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:29.852889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.854472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.912189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:29.928631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.929407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.929690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.930018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.930686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.933003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.942510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335adf1d-f575-4002-8353-8625220e67f9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.949254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.949998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.950545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.950890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.951783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.954071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:29.959134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 755/1515] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:29.959134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.959387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.979856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e50d2-6c63-45c7-b9ea-50f3b3ae4eb1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:29.981498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 761/1516] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:29 2022] POST /identity/v3/users => generated 279 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:29.982504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:29.985510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:29.988820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:29.989550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:29.989824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:29.990093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] PATH_INFO: `/v3/users/8e8e11da3b234f78967658df92b37e91` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:29.991383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8e11da3b234f78967658df92b37e91)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:29.994028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.001364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04208c75-34a4-45b2-a434-71d62ef82e4f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.006278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.007076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.007578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.008143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.009526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.011481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.026551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 762/1517] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:30.027379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.041617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cc0bb-ae3d-4221-a0e2-5c886d247314 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.052658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4c4e6-8214-4d5f-bb50-6ced16715798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.053283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c4e6-8214-4d5f-bb50-6ced16715798 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.053563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c4e6-8214-4d5f-bb50-6ced16715798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.053832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c4e6-8214-4d5f-bb50-6ced16715798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.054550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4c4e6-8214-4d5f-bb50-6ced16715798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.057970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4c4e6-8214-4d5f-bb50-6ced16715798 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.081236 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 763/1518] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:30.082903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42420-fac1-4737-a8e2-06e81b3f8c74 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.083653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42420-fac1-4737-a8e2-06e81b3f8c74 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.084015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42420-fac1-4737-a8e2-06e81b3f8c74 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.085290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 764/1519] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:05:30.086042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42420-fac1-4737-a8e2-06e81b3f8c74 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.090490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8e11da3b234f78967658df92b37e91'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:30.128308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42420-fac1-4737-a8e2-06e81b3f8c74 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.139025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec8674-7069-40f4-b11a-3b455c7b4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.139744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec8674-7069-40f4-b11a-3b455c7b4dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.140012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec8674-7069-40f4-b11a-3b455c7b4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.140405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec8674-7069-40f4-b11a-3b455c7b4dc8 admin admin] PATH_INFO: `/v3/projects/fd437114ee25440dbf697e46f96e787c/users/d234971b07ce441fb3da5635c2bc4cc6/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.143033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8e11da3b234f78967658df92b37e91'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:30.144104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8e11da3b234f78967658df92b37e91'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:30.153849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8e11da3b234f78967658df92b37e91'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:30.166670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8e11da3b234f78967658df92b37e91'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:30.172919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec8674-7069-40f4-b11a-3b455c7b4dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd437114ee25440dbf697e46f96e787c, user_id=d234971b07ce441fb3da5635c2bc4cc6, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.191080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec8674-7069-40f4-b11a-3b455c7b4dc8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.194086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 756/1520] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:29 2022] DELETE /identity/v3/users/8e8e11da3b234f78967658df92b37e91 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:30.197416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.201100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.219144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 765/1521] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:30 2022] PUT /identity/v3/projects/fd437114ee25440dbf697e46f96e787c/users/d234971b07ce441fb3da5635c2bc4cc6/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:30.221496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.222338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.223502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.283913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:30.290084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.356951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:30.374865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6189ad-fd74-4f5b-a415-96a42f83dc4b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.411362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 766/1522] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:30.412046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.413391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.443290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.444180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.444523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.445142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.445815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.447868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.463048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 757/1523] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:30.464049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.474671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c1bef-6c9e-475d-be70-b6cbad84dbee admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.480162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4452-e132-4266-a830-125450cdb85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.480968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4452-e132-4266-a830-125450cdb85d admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.481341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4452-e132-4266-a830-125450cdb85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.481731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4452-e132-4266-a830-125450cdb85d admin admin] PATH_INFO: `/v3/projects/d74a9e0ff7d442e2bc3ee1c403d6085f/users/2ab8bc72c6764a7996d10f4c263da3de/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.502027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff4452-e132-4266-a830-125450cdb85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74a9e0ff7d442e2bc3ee1c403d6085f, user_id=2ab8bc72c6764a7996d10f4c263da3de, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.503678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c74d2f-658d-4160-b4dc-f2c7527be814 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.505254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff4452-e132-4266-a830-125450cdb85d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.508809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.509417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.509708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.509972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.510708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.512357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.528619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 758/1524] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:30 2022] PUT /identity/v3/projects/d74a9e0ff7d442e2bc3ee1c403d6085f/users/2ab8bc72c6764a7996d10f4c263da3de/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:30.528933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 767/1525] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:30.534064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.535505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f18e-5b34-4b54-bab4-7641ae074630 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.535891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f18e-5b34-4b54-bab4-7641ae074630 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.536056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f18e-5b34-4b54-bab4-7641ae074630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.557491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894543-e36b-4e82-9ecc-507561124dcb admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.572960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:30.578717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5538f18e-5b34-4b54-bab4-7641ae074630 None None] MFA Rules not processed for user `2ab8bc72c6764a7996d10f4c263da3de`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:30.580078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5538f18e-5b34-4b54-bab4-7641ae074630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.664088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.665652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.666034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.666729 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] PATH_INFO: `/v3/projects/fd437114ee25440dbf697e46f96e787c/users/d234971b07ce441fb3da5635c2bc4cc6/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.674234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd437114ee25440dbf697e46f96e787c, user_id=d234971b07ce441fb3da5635c2bc4cc6, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.676957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.700888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 768/1526] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:30 2022] PUT /identity/v3/projects/fd437114ee25440dbf697e46f96e787c/users/d234971b07ce441fb3da5635c2bc4cc6/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:30.700888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.701044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 759/1527] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:30.703185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.705491 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.706869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.707122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.771404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] MFA Rules not processed for user `d234971b07ce441fb3da5635c2bc4cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:30.773566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.823822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58d4f-d543-46f3-9f8e-921bc1905cd3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:30.830658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:30.831398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:30.831845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:30.832452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:30.847645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:30.850687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:30.867114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:30.900251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 769/1528] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:30.902353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 760/1529] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:30.903326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.904832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:30.917188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:30.919139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.006172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6c79-1d19-478d-a139-df5adbb1d5d8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.010129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.010815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.011185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.011523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.022990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f674cdc-99ac-4b1e-b7d0-fa3a68429303 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.029745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.030647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.031011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.031505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.054739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.057355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.069113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 770/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:31.076460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.080680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.128793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.130381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.139704 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:31.151034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 761/1531] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:31.152216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.216637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303b208-941d-4320-88c4-3f905c489dc8 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.222803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.223741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.224025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.224294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] PATH_INFO: `/v3/projects/0cbedf0e18c24303876775d0c945197d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.225609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbedf0e18c24303876775d0c945197d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.227559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.246682 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b57d2d-f4db-464a-af50-aa6e57bb215b service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.253931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.254927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.255430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.255706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] PATH_INFO: `/v3/users/2322ae0cbbee4712b04b39381385a61c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.257153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2322ae0cbbee4712b04b39381385a61c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.259854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.317632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbedf0e18c24303876775d0c945197d', 'request_id': 'req-9d873652-a6c8-4687-90ee-9b81c2544146'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.328347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbedf0e18c24303876775d0c945197d', 'request_id': 'req-9d873652-a6c8-4687-90ee-9b81c2544146'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.338392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbedf0e18c24303876775d0c945197d', 'request_id': 'req-9d873652-a6c8-4687-90ee-9b81c2544146'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.354636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] The token cache is being invalidate because project 0cbedf0e18c24303876775d0c945197d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:31.355194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.355943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.359154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:31.361264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 771/1532] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:31 2022] DELETE /identity/v3/projects/0cbedf0e18c24303876775d0c945197d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:31.362391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.364089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.370190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2322ae0cbbee4712b04b39381385a61c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.402810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2322ae0cbbee4712b04b39381385a61c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.403662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2322ae0cbbee4712b04b39381385a61c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.419783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2322ae0cbbee4712b04b39381385a61c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.438105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-87c43a5f-53a1-4e4f-9f5b-a6185c9f497a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2322ae0cbbee4712b04b39381385a61c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.449637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 762/1533] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:31 2022] DELETE /identity/v3/users/2322ae0cbbee4712b04b39381385a61c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:31.455046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcbdcc-d350-4d20-9bc5-9afca6cdf546 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.455666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcbdcc-d350-4d20-9bc5-9afca6cdf546 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.462786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcbdcc-d350-4d20-9bc5-9afca6cdf546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.478931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d873652-a6c8-4687-90ee-9b81c2544146 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.507747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3cfcbdcc-d350-4d20-9bc5-9afca6cdf546 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:31.509534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3cfcbdcc-d350-4d20-9bc5-9afca6cdf546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.577498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.578264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.578539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.578862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] PATH_INFO: `/v3/users/2ab8bc72c6764a7996d10f4c263da3de` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.580187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab8bc72c6764a7996d10f4c263da3de)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.582754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.595498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:31.603407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 763/1534] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:31.605109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38402e3-547b-4568-b3cf-56d06d1757c7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.605394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38402e3-547b-4568-b3cf-56d06d1757c7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.605667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38402e3-547b-4568-b3cf-56d06d1757c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.628587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b38402e3-547b-4568-b3cf-56d06d1757c7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:31.631367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b38402e3-547b-4568-b3cf-56d06d1757c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.640493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 764/1535] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:31.642878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.643503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.644508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.673292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:31.674739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.678727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab8bc72c6764a7996d10f4c263da3de'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.688639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 765/1536] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:31.688639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.688639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.696505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab8bc72c6764a7996d10f4c263da3de'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.697139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab8bc72c6764a7996d10f4c263da3de'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.704963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab8bc72c6764a7996d10f4c263da3de'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.715802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab8bc72c6764a7996d10f4c263da3de'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:31.725730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 772/1537] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:31 2022] DELETE /identity/v3/users/2ab8bc72c6764a7996d10f4c263da3de => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:31.725730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.728817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.779059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca85e9b-9ee5-48cc-956e-83512f8a6401 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.816799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1d14-2f50-4d06-a674-6a87678b1c20 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.823156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.823880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.824164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.824569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.825214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:31.825564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.827240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e27d6-8ee3-486f-b8fa-061cc0241c4f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.847924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 773/1538] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:31.854812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.855104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.855510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.855906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.856810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.857185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.857559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.859454 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.877496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.879042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.882195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:31.884973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.894975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 766/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:31.895416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 774/1540] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:31.895923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.906843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5021f-5623-463c-a750-f6bee2508619 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.911563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.913381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.913774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.913890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:31.914745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.915119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.915935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.918669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.924115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:31.935721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515cbb7-2d85-490e-80b6-2d2433808da4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:31.942785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:31.944830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:31.945016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:31.947308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:31.964642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:31.966879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:31.969746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 767/1541] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:31 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:31.973709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:31.984668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 775/1542] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:05:32.065864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876527ef-44c4-4692-9b6a-5716382aaede admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.079744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.080631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.081005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.081468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.082187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.084576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.139826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 768/1543] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:31 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:32.141101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.152621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a165c-3998-4ec4-b46a-feea0470d7b4 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.167556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.168193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.168516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.168793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.169444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.171138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.184272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 776/1544] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:32.188213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.203069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c114-e65f-4db7-885f-ba9e8960caa0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.209321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052f35c-33cc-47da-98a1-b32a3ca72b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.210229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052f35c-33cc-47da-98a1-b32a3ca72b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.210658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052f35c-33cc-47da-98a1-b32a3ca72b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.211138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052f35c-33cc-47da-98a1-b32a3ca72b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.212539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052f35c-33cc-47da-98a1-b32a3ca72b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.214756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052f35c-33cc-47da-98a1-b32a3ca72b14 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.229981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 769/1545] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:32.234220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.246042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467673fa-6411-4485-98f8-60703ab9db0d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.251443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.252130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.252445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.252724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] PATH_INFO: `/v3/projects/d70fba30f20340668e2c9523222afe6b/users/8c2a5e6ee78c4925b5dd98771c604b37/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.286573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70fba30f20340668e2c9523222afe6b, user_id=8c2a5e6ee78c4925b5dd98771c604b37, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.292734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.319347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 777/1546] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:32 2022] PUT /identity/v3/projects/d70fba30f20340668e2c9523222afe6b/users/8c2a5e6ee78c4925b5dd98771c604b37/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:32.330085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.330370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.330643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.359497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] MFA Rules not processed for user `8c2a5e6ee78c4925b5dd98771c604b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:32.360756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:32.435766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 770/1547] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:32.443091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.502543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:32.573642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.577735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:32.625908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb421da-f01c-4feb-8cbe-2a7fc272727e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.647054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.648260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.648692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.649107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.649758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.651824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.697535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 778/1548] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:32 2022] POST /identity/v3/projects => generated 387 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:32.698606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.700781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:32.704521 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:32.721292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbce54-2a43-4b52-a45e-b5c768e9cd20 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.792828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4199b-e52e-4340-9651-2e098d28ddd3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:32.806371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.807810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.808092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.808400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] PATH_INFO: `/v3/users/2f36e27b5dfb40b6847d90c72c00775c` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.809975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f36e27b5dfb40b6847d90c72c00775c)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.814044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.821288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:32.822237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.822695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.823144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] PATH_INFO: `/v3/projects/507da69b48944695a50dbbb1c2a53c22` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.824741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507da69b48944695a50dbbb1c2a53c22)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:32.827042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:32.886527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f36e27b5dfb40b6847d90c72c00775c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.888810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507da69b48944695a50dbbb1c2a53c22', 'request_id': 'req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.905388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f36e27b5dfb40b6847d90c72c00775c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.906789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f36e27b5dfb40b6847d90c72c00775c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.919609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f36e27b5dfb40b6847d90c72c00775c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.931314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507da69b48944695a50dbbb1c2a53c22', 'request_id': 'req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.940405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507da69b48944695a50dbbb1c2a53c22', 'request_id': 'req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.941102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f36e27b5dfb40b6847d90c72c00775c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.956123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 779/1549] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:32 2022] DELETE /identity/v3/users/2f36e27b5dfb40b6847d90c72c00775c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:32.962195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:32.962624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] The token cache is being invalidate because project 507da69b48944695a50dbbb1c2a53c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:32.962927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.963588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-30fcc4c8-3f7d-4d1f-87aa-89fd2d8a4c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:32.964564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:32.968571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 771/1550] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:32 2022] DELETE /identity/v3/projects/507da69b48944695a50dbbb1c2a53c22 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:32.968571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:32.968571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:32.968571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:32.996566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:32.997960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.022785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:33.061945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef84c58-e522-4cf1-8f20-3d896b9f4177 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.067749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.068419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.068718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.068985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.070223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.071866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 772/1551] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:33.072199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.072791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.099198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.113106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 780/1552] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:32 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:33.114013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.119325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.135877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61b93-b8dd-4865-a02a-181025bafad2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.136755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b1e60-9bb3-4e5c-a668-6a8e264a1834 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.142165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.142864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.143203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.143476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] PATH_INFO: `/v3/projects/d74a9e0ff7d442e2bc3ee1c403d6085f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.144798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74a9e0ff7d442e2bc3ee1c403d6085f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.147737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.150293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.150921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.151290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.151569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] PATH_INFO: `/v3/users/d234971b07ce441fb3da5635c2bc4cc6` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.152876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d234971b07ce441fb3da5635c2bc4cc6)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.155208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.193151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:33.217056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd234971b07ce441fb3da5635c2bc4cc6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.222341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74a9e0ff7d442e2bc3ee1c403d6085f', 'request_id': 'req-593b64aa-1588-4f0d-862a-290445091334'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.234203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd234971b07ce441fb3da5635c2bc4cc6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.234435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74a9e0ff7d442e2bc3ee1c403d6085f', 'request_id': 'req-593b64aa-1588-4f0d-862a-290445091334'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.234983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd234971b07ce441fb3da5635c2bc4cc6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.244099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd234971b07ce441fb3da5635c2bc4cc6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.249434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74a9e0ff7d442e2bc3ee1c403d6085f', 'request_id': 'req-593b64aa-1588-4f0d-862a-290445091334'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.254833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd234971b07ce441fb3da5635c2bc4cc6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.266447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] The token cache is being invalidate because project d74a9e0ff7d442e2bc3ee1c403d6085f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:33.266615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 773/1553] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:33 2022] DELETE /identity/v3/users/d234971b07ce441fb3da5635c2bc4cc6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:33.266693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.267420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.267528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:33.269254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 781/1554] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:33 2022] DELETE /identity/v3/projects/d74a9e0ff7d442e2bc3ee1c403d6085f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:33.270073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.274847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.275553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.426636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b64aa-1588-4f0d-862a-290445091334 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.429439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae1cc7-77e6-4def-b87d-ea6136d6728e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.442453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.443144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.443344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.443613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.449120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.541965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:33.565935 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610e9a-4fcd-4b51-8e8d-7ff28f9b3d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.566421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.566979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610e9a-4fcd-4b51-8e8d-7ff28f9b3d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.567393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610e9a-4fcd-4b51-8e8d-7ff28f9b3d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.567808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610e9a-4fcd-4b51-8e8d-7ff28f9b3d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.568473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.568664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8610e9a-4fcd-4b51-8e8d-7ff28f9b3d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.571681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8610e9a-4fcd-4b51-8e8d-7ff28f9b3d54 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.584307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 782/1555] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:33.585964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3105d8-831b-4538-ae48-2b273555f861 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.586937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3105d8-831b-4538-ae48-2b273555f861 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.587295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3105d8-831b-4538-ae48-2b273555f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.591303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 774/1556] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:33.592418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.610117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b075b-0b2e-488a-98a1-83f5d70ec07b service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.620790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.624803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.625208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.625585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.627636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.630527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-fc3105d8-831b-4538-ae48-2b273555f861 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:33.631828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fc3105d8-831b-4538-ae48-2b273555f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.631947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.643197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 783/1557] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:33.653796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.654075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.654348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.662605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 775/1558] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:33.664373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.675014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:33.677025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.690085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 784/1559] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:33.691435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.694738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203963a-a055-47de-9d9c-24aeed138fe7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.702251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05635-e7ed-4e54-a7a9-7299a658319f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.704727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ff44d-a342-4add-ad2d-0b8eabb576f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.705333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ff44d-a342-4add-ad2d-0b8eabb576f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.705630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ff44d-a342-4add-ad2d-0b8eabb576f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.707359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.708148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.708555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ff44d-a342-4add-ad2d-0b8eabb576f5 admin admin] PATH_INFO: `/v3/projects/03b433d976014997944f29dd22ca3d1b/users/3661ee4a43d943608d20abbd70649148/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.708664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.708995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.709744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:33.710146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.712909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.739758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 785/1560] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:33.739939 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ff44d-a342-4add-ad2d-0b8eabb576f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b433d976014997944f29dd22ca3d1b, user_id=3661ee4a43d943608d20abbd70649148, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.741011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.741808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ff44d-a342-4add-ad2d-0b8eabb576f5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.765526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0d7c-02a0-42bd-8019-aa2e9989df47 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.768733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 776/1561] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:33 2022] PUT /identity/v3/projects/03b433d976014997944f29dd22ca3d1b/users/3661ee4a43d943608d20abbd70649148/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:33.781541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9508-704c-44f3-882b-896679d6c279 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.781842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9508-704c-44f3-882b-896679d6c279 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.782163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9508-704c-44f3-882b-896679d6c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.828429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-baec9508-704c-44f3-882b-896679d6c279 None None] MFA Rules not processed for user `3661ee4a43d943608d20abbd70649148`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:33.830965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-baec9508-704c-44f3-882b-896679d6c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.837897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:33.904814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.905818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.906179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.906527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.907581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.909327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.916016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 777/1562] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:33.917054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9508-704c-44f3-882b-896679d6c279 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.918340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-baec9508-704c-44f3-882b-896679d6c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:33.932757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9508-704c-44f3-882b-896679d6c279 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:33.938000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:33.939548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:33.939954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:33.940384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] PATH_INFO: `/v3/projects/fd437114ee25440dbf697e46f96e787c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:33.942164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd437114ee25440dbf697e46f96e787c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:33.944381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:33.946151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 786/1563] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:33 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:33.947086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:33.998775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd437114ee25440dbf697e46f96e787c', 'request_id': 'req-20dd53dc-24c1-4353-a4d8-ea30e750e15d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.008277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd437114ee25440dbf697e46f96e787c', 'request_id': 'req-20dd53dc-24c1-4353-a4d8-ea30e750e15d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.015548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd437114ee25440dbf697e46f96e787c', 'request_id': 'req-20dd53dc-24c1-4353-a4d8-ea30e750e15d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.024450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a05f-59c1-4452-834f-132890b6e723 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.028431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] The token cache is being invalidate because project fd437114ee25440dbf697e46f96e787c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:34.028724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.032876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.036694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 778/1564] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:33 2022] DELETE /identity/v3/projects/fd437114ee25440dbf697e46f96e787c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:34.036694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.038375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.097098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:34.110286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.110904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.111163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.111433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.112322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.114295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.126426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd53dc-24c1-4353-a4d8-ea30e750e15d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.132243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc956c6-8ec8-4492-a0df-c1dd6276d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.133411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc956c6-8ec8-4492-a0df-c1dd6276d198 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.133750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc956c6-8ec8-4492-a0df-c1dd6276d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.134225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc956c6-8ec8-4492-a0df-c1dd6276d198 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.135175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc956c6-8ec8-4492-a0df-c1dd6276d198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.136828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc956c6-8ec8-4492-a0df-c1dd6276d198 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.162915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 787/1565] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:33 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:34.163818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.166497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.189077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 779/1566] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:34 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:34.193803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.194080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.194353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.222092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:34.223596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.239053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:34.272946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8aa4b0-b226-4fd3-8709-38d0b803436b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.279423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.280086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.280363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.280649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] PATH_INFO: `/v3/projects/b96e6fa497f84d59b92ea5a033aa85ca` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.281790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96e6fa497f84d59b92ea5a033aa85ca)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.283733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.329388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 780/1567] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:34.330408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.331917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.346139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833371-3547-4cf4-91bf-499c79380ec4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.362777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96e6fa497f84d59b92ea5a033aa85ca', 'request_id': 'req-9430720b-92a9-4528-b98b-91aea84c270c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.378813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96e6fa497f84d59b92ea5a033aa85ca', 'request_id': 'req-9430720b-92a9-4528-b98b-91aea84c270c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.390549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96e6fa497f84d59b92ea5a033aa85ca', 'request_id': 'req-9430720b-92a9-4528-b98b-91aea84c270c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.414952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] The token cache is being invalidate because project b96e6fa497f84d59b92ea5a033aa85ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:34.415265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.415933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.417870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 788/1568] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:34 2022] DELETE /identity/v3/projects/b96e6fa497f84d59b92ea5a033aa85ca => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:34.418702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.420005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.430339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.430968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.431245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.431515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.432150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.433318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430720b-92a9-4528-b98b-91aea84c270c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.434309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.440993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a8099-12b4-4817-afaf-2c241c34b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.441651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8099-12b4-4817-afaf-2c241c34b6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.441883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8099-12b4-4817-afaf-2c241c34b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.442153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8099-12b4-4817-afaf-2c241c34b6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.442801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8099-12b4-4817-afaf-2c241c34b6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.444546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8099-12b4-4817-afaf-2c241c34b6b1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.458746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 789/1569] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:34.460213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.460659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.460943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.463136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 781/1570] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:34 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:34.464294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.466094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.479479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79057c-0a0e-42cc-869a-85744c5b31af admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.484790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.485420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.485695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.485968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] PATH_INFO: `/v3/users/1693e9df98414a33970a744ecf595514` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.487471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1693e9df98414a33970a744ecf595514)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.488011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:34.489349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.489583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.499737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 790/1571] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:34.500743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.512607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c94d-1c51-4bcb-a1ee-c4a76b095e67 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.519547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.519924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.520497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.520963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.522395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.524371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.538627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 791/1572] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:34.539908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.542232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.558658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1975eb-22b0-4c53-be48-ac00fd2109ca admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.559872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1693e9df98414a33970a744ecf595514'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.565145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.565985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.566348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.566793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.567626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.571358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.576591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1693e9df98414a33970a744ecf595514'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.577519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1693e9df98414a33970a744ecf595514'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.585882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1693e9df98414a33970a744ecf595514'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.591306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 792/1573] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:34.592445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.605137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95baa29-43ad-4a78-9b4f-cdd3ccc76be0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.607537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1693e9df98414a33970a744ecf595514'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:34.610320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.611002 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.611413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.612015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.612817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:34.613181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.615151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.623406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 782/1574] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:34 2022] DELETE /identity/v3/users/1693e9df98414a33970a744ecf595514 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:34.623406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.631379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 793/1575] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:34.632304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.634305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.634710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.652395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dfed0-5a29-457b-9225-ede6a7397444 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.666148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:34.695358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:34.776064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.777056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.777444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.777803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] PATH_INFO: `/v3/projects/81f20a37da73473786c89407ef369d70/users/5b1f645816bd4765908ef5477d52489d/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.802881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f20a37da73473786c89407ef369d70, user_id=5b1f645816bd4765908ef5477d52489d, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.813978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.821663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7ecc-6c88-46a0-b0c8-f956c302c663 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:34.828785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:34.829681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:34.830146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:34.830527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] PATH_INFO: `/v3/projects/249c207f8ac8472d93eccb11886c7a27/users/52d25623214949baa59106c8e9b3b061/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:34.880417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 794/1576] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:34 2022] PUT /identity/v3/projects/81f20a37da73473786c89407ef369d70/users/5b1f645816bd4765908ef5477d52489d/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:34.881942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.883173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249c207f8ac8472d93eccb11886c7a27, user_id=52d25623214949baa59106c8e9b3b061, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:34.884538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:34.888388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:34.919601 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 783/1577] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:34 2022] PUT /identity/v3/projects/249c207f8ac8472d93eccb11886c7a27/users/52d25623214949baa59106c8e9b3b061/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:34.924961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:34.993926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976d9d-e5e0-4c1c-a2ba-9e0d448d3713 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.022115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048624d3-d74b-4603-b7ee-cb02d8996837 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.028367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372161dd-7204-4c06-9517-2c074b0c453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.029106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372161dd-7204-4c06-9517-2c074b0c453c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.029445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372161dd-7204-4c06-9517-2c074b0c453c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.029779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372161dd-7204-4c06-9517-2c074b0c453c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.031004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372161dd-7204-4c06-9517-2c074b0c453c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.033560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372161dd-7204-4c06-9517-2c074b0c453c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.048849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 784/1578] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:35.050144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.050735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.051086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.069372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.070006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.070837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.071737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.072200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.074377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.089486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] MFA Rules not processed for user `52d25623214949baa59106c8e9b3b061`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:35.094345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:35.120390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 795/1579] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:34 2022] POST /identity/v3/projects => generated 391 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:35.121401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.197118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:35.237705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 785/1580] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:35.242993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.263058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1945b-f7df-47da-9f8c-57d9d211fded admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.269544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.270895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.271293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.271610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] PATH_INFO: `/v3/projects/81f20a37da73473786c89407ef369d70/users/5b1f645816bd4765908ef5477d52489d/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.274779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f20a37da73473786c89407ef369d70, user_id=5b1f645816bd4765908ef5477d52489d, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.276594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb35925-4d81-45d3-9d94-c9b7b95cbad9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.279795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.286941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809d14f-85b5-4d62-be7c-c504aee7804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.289165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809d14f-85b5-4d62-be7c-c504aee7804c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.292243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809d14f-85b5-4d62-be7c-c504aee7804c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.293923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809d14f-85b5-4d62-be7c-c504aee7804c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.294672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809d14f-85b5-4d62-be7c-c504aee7804c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.296194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 796/1581] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:35 2022] PUT /identity/v3/projects/81f20a37da73473786c89407ef369d70/users/5b1f645816bd4765908ef5477d52489d/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:35.299079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.302422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809d14f-85b5-4d62-be7c-c504aee7804c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.347514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 786/1582] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:35 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:35.349433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.349840 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.350123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.401698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:35.409957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] MFA Rules not processed for user `5b1f645816bd4765908ef5477d52489d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:35.412687 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:35.548103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03247485-489f-42bc-ac50-f487b9d475ec admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.557796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.558821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.560278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.561866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.564781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.567950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.579062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 787/1583] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:35.580393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.600018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f639f9-d82c-4f1b-8af5-178e19d1c4aa None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.610309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.611368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.612193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.612756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.613662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.616832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.640251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 788/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:35.641613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.648565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 797/1585] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:35 2022] POST /identity/v3/projects => generated 373 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:35.648565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.649945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:35.650866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:35.682321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ca065-304c-44bc-8097-84596c01f29d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.733944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a199421-f771-450e-9a3a-7aac4b4aaa32 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.740374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.741551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.742032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.743060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.753932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.754591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.754868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.755177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] PATH_INFO: `/v3/projects/1e696ab27ee14b8b9c8a0fd4aa98b6ac` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.756849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e696ab27ee14b8b9c8a0fd4aa98b6ac)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.758972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.822527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e696ab27ee14b8b9c8a0fd4aa98b6ac', 'request_id': 'req-2a48f642-2940-4ba9-8e59-f31e9d511e96'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:35.832923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.833149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e696ab27ee14b8b9c8a0fd4aa98b6ac', 'request_id': 'req-2a48f642-2940-4ba9-8e59-f31e9d511e96'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:35.835013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.839238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e696ab27ee14b8b9c8a0fd4aa98b6ac', 'request_id': 'req-2a48f642-2940-4ba9-8e59-f31e9d511e96'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:35.843229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:35.850540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 798/1586] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:35.853104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.863430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] The token cache is being invalidate because project 1e696ab27ee14b8b9c8a0fd4aa98b6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:35.863717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:35.864444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:35.865986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 789/1587] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:35 2022] DELETE /identity/v3/projects/1e696ab27ee14b8b9c8a0fd4aa98b6ac => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:35.872425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:35.874086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:35.875294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd5252-9736-40ee-b550-391f5d4e3a1a service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.898133 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:35.978303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f642-2940-4ba9-8e59-f31e9d511e96 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:35.985348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f1c8-e9d5-4634-b10a-32e1356cd9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.985570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:35.986070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f1c8-e9d5-4634-b10a-32e1356cd9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.986415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f1c8-e9d5-4634-b10a-32e1356cd9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.987013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f1c8-e9d5-4634-b10a-32e1356cd9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.987468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:35.987783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f1c8-e9d5-4634-b10a-32e1356cd9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.988211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:35.988654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:35.989526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:35.989851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f1c8-e9d5-4634-b10a-32e1356cd9bd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:35.992152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.006742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 799/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:36.009128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.009887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.010486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.020114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 790/1589] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:35 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:36.021033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.023370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.036155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc66926-d70d-4e8d-bc3a-d5fc9c7722cb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.040114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:36.041848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.041970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0abf-406d-42d3-af95-5edf26741d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.042630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0abf-406d-42d3-af95-5edf26741d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.042908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0abf-406d-42d3-af95-5edf26741d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.043322 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0abf-406d-42d3-af95-5edf26741d62 admin admin] PATH_INFO: `/v3/projects/cb426d8c1ab04a1ab0c7be3579e3c6ac/users/cd195798e2a2470387305cb5a1dd5331/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.053077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 800/1590] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:36.054224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.068776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d9df-d34a-45bc-a1f5-f87fca261ba7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.072019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0abf-406d-42d3-af95-5edf26741d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb426d8c1ab04a1ab0c7be3579e3c6ac, user_id=cd195798e2a2470387305cb5a1dd5331, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.075037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.075299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0abf-406d-42d3-af95-5edf26741d62 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.075881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.076595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.077467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.077688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.080193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.104974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 791/1591] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:36 2022] PUT /identity/v3/projects/cb426d8c1ab04a1ab0c7be3579e3c6ac/users/cd195798e2a2470387305cb5a1dd5331/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:36.106256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677dc0-de19-4ffa-9dfa-f18d11a3a36e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.110474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677dc0-de19-4ffa-9dfa-f18d11a3a36e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.110603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 801/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:36.110681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677dc0-de19-4ffa-9dfa-f18d11a3a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.111137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.147003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4d677dc0-de19-4ffa-9dfa-f18d11a3a36e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:36.148289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4d677dc0-de19-4ffa-9dfa-f18d11a3a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.157315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d52948-1266-4e61-8a30-c11c1b84769d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.260402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 792/1593] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:36.260402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.260402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.261880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.267568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.268318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.268627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.269036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] PATH_INFO: `/v3/projects/65d24639a24e45dd90e9b5fd1e220420/users/f2b636a20a0d45519bdc784f246043d1/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.292474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d24639a24e45dd90e9b5fd1e220420, user_id=f2b636a20a0d45519bdc784f246043d1, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.295967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.302315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] MFA Rules not processed for user `cd195798e2a2470387305cb5a1dd5331`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:36.303710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.330162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 802/1594] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:36 2022] PUT /identity/v3/projects/65d24639a24e45dd90e9b5fd1e220420/users/f2b636a20a0d45519bdc784f246043d1/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:36.331482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.449318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 793/1595] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:36.454215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.481168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d23ee-0166-45ef-a879-f045522487f5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.481630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeafd35-2bba-491f-a1ce-4fea11304bb5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.488440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.489104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.489454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.489833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.490487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:36.490839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.493166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.493796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.494865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.495404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.496538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:36.496882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.498256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.502584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.522367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 803/1596] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:36.522367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.523861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 794/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:36.524884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.532022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:36.542389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4538-2e2e-4585-961f-24a5775c950c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.552591 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5780c1-5cf8-4e54-94ff-2f0c2c5c4a6c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.552718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adc9f6-088c-4da2-9146-481bba641d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.553258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adc9f6-088c-4da2-9146-481bba641d56 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.553536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adc9f6-088c-4da2-9146-481bba641d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.553804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adc9f6-088c-4da2-9146-481bba641d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.556327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.557198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.557795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adc9f6-088c-4da2-9146-481bba641d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.558090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.558577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] PATH_INFO: `/v3/projects/65d24639a24e45dd90e9b5fd1e220420/users/f2b636a20a0d45519bdc784f246043d1/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.559973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adc9f6-088c-4da2-9146-481bba641d56 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.560798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d24639a24e45dd90e9b5fd1e220420, user_id=f2b636a20a0d45519bdc784f246043d1, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.563845 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.606482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 795/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:36 2022] PUT /identity/v3/projects/65d24639a24e45dd90e9b5fd1e220420/users/f2b636a20a0d45519bdc784f246043d1/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:36.607337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.619474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 804/1599] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:36.620850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.621140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.621413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.663284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] MFA Rules not processed for user `f2b636a20a0d45519bdc784f246043d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:36.665384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.763948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0e04f-d8ea-420f-aa6c-2065f3ef3bae admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.808356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 805/1600] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:36.808356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.866888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.867747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.868172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.869109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.870108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.873193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.904569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52f5e3-6a4c-4483-941a-f0ea368c2d33 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.910907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 796/1601] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:36.910907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.910907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.911838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.912753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.913134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.913503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.914899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:36.916953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:36.946173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 806/1602] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:36 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:36.947081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:36.949943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:36.982366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef804-b1ee-4570-b3aa-ea91dae2ae06 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:36.987100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:36.987904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:36.988325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:36.988807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:36.990846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:37.017598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:37.024054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0270c-239d-4b8a-9cff-4841df546689 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.028895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01892176-d576-4593-b691-5af537979681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.030867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:37.031343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01892176-d576-4593-b691-5af537979681 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.031878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01892176-d576-4593-b691-5af537979681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.032325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01892176-d576-4593-b691-5af537979681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.034416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-01892176-d576-4593-b691-5af537979681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:37.067898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.069940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.081073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 797/1603] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:37.081820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.192856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035a4d4-0d1e-4c9c-a194-41539f623da0 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.199078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.199708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.199983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.200457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.201090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.203304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.251662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 798/1604] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:37 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:37.253062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.269221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac3d41-369a-4871-ad53-cb3b5dfa8b94 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.278689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b6f42-4ff3-45be-bdf6-193b7a3294df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.279365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b6f42-4ff3-45be-bdf6-193b7a3294df admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.279992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b6f42-4ff3-45be-bdf6-193b7a3294df admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.279992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b6f42-4ff3-45be-bdf6-193b7a3294df admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.282210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b6f42-4ff3-45be-bdf6-193b7a3294df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.284079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b6f42-4ff3-45be-bdf6-193b7a3294df admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.307344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01892176-d576-4593-b691-5af537979681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.308837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01892176-d576-4593-b691-5af537979681 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.314986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 799/1605] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:37.316379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f2b7-125d-4b5f-84f8-f45197ea5127 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.316658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f2b7-125d-4b5f-84f8-f45197ea5127 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.316929 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f2b7-125d-4b5f-84f8-f45197ea5127 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.318352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 800/1606] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:05:37.318898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f2b7-125d-4b5f-84f8-f45197ea5127 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.327885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 807/1607] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:37.329962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01892176-d576-4593-b691-5af537979681 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.355461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f2b7-125d-4b5f-84f8-f45197ea5127 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.356434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01892176-d576-4593-b691-5af537979681 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.372720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b0625-671d-4bd9-a1ca-b3d2a361434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.373407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.374091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.375625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b0625-671d-4bd9-a1ca-b3d2a361434d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.375903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b0625-671d-4bd9-a1ca-b3d2a361434d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.376487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b0625-671d-4bd9-a1ca-b3d2a361434d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.376653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.376925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] PATH_INFO: `/v3/projects/cea13110a6a241c09e56035ac224486e/users/1254ca5301f442a38d4c7e147044041a/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.380892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b0625-671d-4bd9-a1ca-b3d2a361434d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.386952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b0625-671d-4bd9-a1ca-b3d2a361434d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.424982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 801/1608] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:37.426642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.427073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.429689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.433506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea13110a6a241c09e56035ac224486e, user_id=1254ca5301f442a38d4c7e147044041a, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.442815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.472608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:37.481009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:37.499130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 808/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:37 2022] PUT /identity/v3/projects/cea13110a6a241c09e56035ac224486e/users/1254ca5301f442a38d4c7e147044041a/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:37.502170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.658094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7882a1-9ace-4c02-9cfb-be0484d4d3e7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.676256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.677846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.682517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.683200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.692713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.692713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.693731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 802/1610] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:37.694620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.728614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89838698-0086-48b1-a22e-01445bd1a246 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.733397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 809/1611] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:37.734738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.753015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.753660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.753943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.754299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.754872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.764021 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.771212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f49c24-22b6-4801-9539-27d4c9d51634 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.783559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 803/1612] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:37.783559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.790158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576458b-d235-473e-8a0b-e847c6ada170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.790856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576458b-d235-473e-8a0b-e847c6ada170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.791184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576458b-d235-473e-8a0b-e847c6ada170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.791621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576458b-d235-473e-8a0b-e847c6ada170 admin admin] PATH_INFO: `/v3/projects/a362efd215f045e6b5ec8071654f9a05/users/94c0bcf0e0984f1cbb62dfab4ab8769d/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.793630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:37.830849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0132626-a999-44fe-b40f-90e70689a394 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.837063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576458b-d235-473e-8a0b-e847c6ada170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a362efd215f045e6b5ec8071654f9a05, user_id=94c0bcf0e0984f1cbb62dfab4ab8769d, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.839995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576458b-d235-473e-8a0b-e847c6ada170 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.850705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:37.851553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.852387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.852653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.869443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:37.871207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:37.908223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 804/1613] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:37.909179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:37.911067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 810/1614] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:37 2022] PUT /identity/v3/projects/a362efd215f045e6b5ec8071654f9a05/users/94c0bcf0e0984f1cbb62dfab4ab8769d/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:37.921261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:37.928421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:37.928786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:37.946389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e37e-e784-4b27-ab04-478b2ed67977 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:37.968170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:38.001537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] MFA Rules not processed for user `94c0bcf0e0984f1cbb62dfab4ab8769d`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:38.004907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:38.081760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:38.124505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 811/1615] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:38.127972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.150046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad89d-dfe6-450d-9165-256f0395434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.150937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad89d-dfe6-450d-9165-256f0395434d admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.151550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad89d-dfe6-450d-9165-256f0395434d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.152078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad89d-dfe6-450d-9165-256f0395434d admin admin] PATH_INFO: `/v3/projects/cea13110a6a241c09e56035ac224486e/users/1254ca5301f442a38d4c7e147044041a/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.154984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad89d-dfe6-450d-9165-256f0395434d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea13110a6a241c09e56035ac224486e, user_id=1254ca5301f442a38d4c7e147044041a, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.158811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad89d-dfe6-450d-9165-256f0395434d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.174023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 805/1616] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:37 2022] PUT /identity/v3/projects/cea13110a6a241c09e56035ac224486e/users/1254ca5301f442a38d4c7e147044041a/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:38.190099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.190731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.191687 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.242310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba13d0-ff8f-4d65-b529-9b8146cc296e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.260632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] MFA Rules not processed for user `1254ca5301f442a38d4c7e147044041a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:38.263040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:38.317985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.318678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.319025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.319388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.320189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.322318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.358466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 812/1617] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:38 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:38.362075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 806/1618] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:38.366327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.373211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.441457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02b1c3-ce52-4e77-a5c7-46456490eb38 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.442997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4553b0f-b60e-4b10-812e-b018ae03e23c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.446318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.446927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.447208 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.447482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.448259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.450219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.474300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 813/1619] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:38 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:38.479007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.484406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:38.492523 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb409-7985-4929-933f-d10a3eb87011 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.499763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.500501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.500675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:38.500979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.501318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.502147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.504136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.508760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.509465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.510049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.510381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.516659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 814/1620] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:05:38.521081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.532845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c38f7-4e1c-4d2c-85e4-ed39e813ca24 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.541825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.542603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.542951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.543296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] PATH_INFO: `/v3/projects/6fc0722ea4e14d06a21dcf65a820950a/users/6887455214cd4184bbb0cc1a5ad7690d/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.561022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc0722ea4e14d06a21dcf65a820950a, user_id=6887455214cd4184bbb0cc1a5ad7690d, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.563766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.578965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 815/1621] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:38 2022] PUT /identity/v3/projects/6fc0722ea4e14d06a21dcf65a820950a/users/6887455214cd4184bbb0cc1a5ad7690d/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:38.582737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.583073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.584715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.595207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 807/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:05:38.652281 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.657993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40285ec7-713c-49fc-a9a4-25d6cb803397 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.662636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.663243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.663518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.663827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.664861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.666443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.673897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a897eb-cc43-462b-9ce9-ff0ba7f6d910 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.681457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 816/1623] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:05:38.682605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.692823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c10834-a361-41c8-a30c-d8a0e600c2ad admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.698711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9656ba7-1eb0-4790-afa6-d197a0c28cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.699388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9656ba7-1eb0-4790-afa6-d197a0c28cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.699667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9656ba7-1eb0-4790-afa6-d197a0c28cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.699941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9656ba7-1eb0-4790-afa6-d197a0c28cc0 admin admin] PATH_INFO: `/v3/projects/6fc0722ea4e14d06a21dcf65a820950a/users/6887455214cd4184bbb0cc1a5ad7690d/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.702417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9656ba7-1eb0-4790-afa6-d197a0c28cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc0722ea4e14d06a21dcf65a820950a, user_id=6887455214cd4184bbb0cc1a5ad7690d, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.705472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9656ba7-1eb0-4790-afa6-d197a0c28cc0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.716748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 817/1624] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:38 2022] PUT /identity/v3/projects/6fc0722ea4e14d06a21dcf65a820950a/users/6887455214cd4184bbb0cc1a5ad7690d/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:38.726648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.726930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.727206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.745215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.746195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.746333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.746632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.757170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] MFA Rules not processed for user `6887455214cd4184bbb0cc1a5ad7690d`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:38.759021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:38.843344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.844831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.857314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 808/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:05:38.873149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 818/1626] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:38.885543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:38.894764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4012a-4550-499b-ac3d-366d3537a0ec service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:38.952504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daf35e-5174-45a5-8d54-324e5284ba47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:38.953193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daf35e-5174-45a5-8d54-324e5284ba47 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:38.953555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daf35e-5174-45a5-8d54-324e5284ba47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:38.953829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daf35e-5174-45a5-8d54-324e5284ba47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:38.960205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:38.967210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daf35e-5174-45a5-8d54-324e5284ba47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:38.968716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daf35e-5174-45a5-8d54-324e5284ba47 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:38.979025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 809/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:39.043848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:39.092090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:39.123156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200962f-00cb-4c40-8294-36c2347d7be7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:39.135189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:39.135915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:39.138830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:39.138830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] PATH_INFO: `/v3/users/52d25623214949baa59106c8e9b3b061` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:39.142124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d25623214949baa59106c8e9b3b061)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:39.144470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:39.222435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d25623214949baa59106c8e9b3b061'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:39.239174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d25623214949baa59106c8e9b3b061'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:39.240449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d25623214949baa59106c8e9b3b061'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:39.252886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d25623214949baa59106c8e9b3b061'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:39.271461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d25623214949baa59106c8e9b3b061'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:39.286624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 819/1628] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:39 2022] DELETE /identity/v3/users/52d25623214949baa59106c8e9b3b061 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:39.291292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:39.291737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:39.291928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:39.312437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:39.313651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:39.384812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 810/1629] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:39.398322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:39.400448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:39.477346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c00a0-3dfa-4a53-9631-2700bc7552c6 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:39.481923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:39.482722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:39.482971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:39.483376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:39.501179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:39.502489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:39.512808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 820/1630] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:39.867675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:39.869240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:39.890121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cde51-a581-4a33-a150-a48189a7b159 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:39.895872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:39.896721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:39.897356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:39.897783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] PATH_INFO: `/v3/projects/249c207f8ac8472d93eccb11886c7a27` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:39.903173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249c207f8ac8472d93eccb11886c7a27)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:39.906676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:39.980149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249c207f8ac8472d93eccb11886c7a27', 'request_id': 'req-269547d3-a825-4afd-a850-6cb1117db074'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:39.987073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:39.988635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:40.005862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249c207f8ac8472d93eccb11886c7a27', 'request_id': 'req-269547d3-a825-4afd-a850-6cb1117db074'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.014236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249c207f8ac8472d93eccb11886c7a27', 'request_id': 'req-269547d3-a825-4afd-a850-6cb1117db074'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.019213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813798fb-68ef-4a91-88b3-a74338d50f59 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:40.026906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] The token cache is being invalidate because project 249c207f8ac8472d93eccb11886c7a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:40.027205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.027867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.032451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 811/1631] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:39 2022] DELETE /identity/v3/projects/249c207f8ac8472d93eccb11886c7a27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:40.034094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:40.035165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:40.110908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:40.126498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269547d3-a825-4afd-a850-6cb1117db074 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:40.128061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:40.129885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:40.130690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:40.130847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] PATH_INFO: `/v3/users/94c0bcf0e0984f1cbb62dfab4ab8769d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:40.132616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c0bcf0e0984f1cbb62dfab4ab8769d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:40.134651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:40.135435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:40.142880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:40.148073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:40.149093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] PATH_INFO: `/v3/users/f2b636a20a0d45519bdc784f246043d1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:40.150744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b636a20a0d45519bdc784f246043d1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:40.152871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:40.179994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:40.223084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b636a20a0d45519bdc784f246043d1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.227380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c0bcf0e0984f1cbb62dfab4ab8769d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.253099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c0bcf0e0984f1cbb62dfab4ab8769d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.254310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c0bcf0e0984f1cbb62dfab4ab8769d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.264803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c0bcf0e0984f1cbb62dfab4ab8769d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.275946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-cadf981f-c2ee-40b3-9b18-c24bb022254b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c0bcf0e0984f1cbb62dfab4ab8769d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.277137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b636a20a0d45519bdc784f246043d1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.281721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b636a20a0d45519bdc784f246043d1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.288538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 821/1632] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:39 2022] DELETE /identity/v3/users/94c0bcf0e0984f1cbb62dfab4ab8769d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:40.292623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:40.293106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:40.293524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:40.301206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b636a20a0d45519bdc784f246043d1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.319444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:40.320078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b636a20a0d45519bdc784f246043d1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:40.322394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:40.349196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 812/1633] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:40 2022] DELETE /identity/v3/users/f2b636a20a0d45519bdc784f246043d1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:40.441237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 822/1634] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:40.456005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:40.460007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:40.616096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a7ad-10fc-4e60-a49a-8db634192a9e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:40.627367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac3f7e-bc78-4368-8607-11ac7ae380aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:40.628680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3f7e-bc78-4368-8607-11ac7ae380aa service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:40.631132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3f7e-bc78-4368-8607-11ac7ae380aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:40.631574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac3f7e-bc78-4368-8607-11ac7ae380aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:40.740566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac3f7e-bc78-4368-8607-11ac7ae380aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:40.746080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac3f7e-bc78-4368-8607-11ac7ae380aa service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:40.777227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 813/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:40.995730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:40.997517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.031444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7adf-c819-4402-b616-2f132a1a120d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.053846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.055313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.055744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.056154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] PATH_INFO: `/v3/projects/65d24639a24e45dd90e9b5fd1e220420` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.057999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d24639a24e45dd90e9b5fd1e220420)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.060958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.146078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d24639a24e45dd90e9b5fd1e220420', 'request_id': 'req-a1b3f76d-c661-4713-bfb9-372917b4ca3d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.157758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d24639a24e45dd90e9b5fd1e220420', 'request_id': 'req-a1b3f76d-c661-4713-bfb9-372917b4ca3d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.167005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d24639a24e45dd90e9b5fd1e220420', 'request_id': 'req-a1b3f76d-c661-4713-bfb9-372917b4ca3d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.180431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:41.187551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] The token cache is being invalidate because project 65d24639a24e45dd90e9b5fd1e220420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:41.189611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.193415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a1b3f76d-c661-4713-bfb9-372917b4ca3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.196163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 823/1636] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:40 2022] DELETE /identity/v3/projects/65d24639a24e45dd90e9b5fd1e220420 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:41.202149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.202149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.202149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.229139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:41.230456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.289926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:41.316898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 814/1637] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:41.329155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.329155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.329155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.366618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:41.368718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.380857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 824/1638] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:41.383834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.398085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235135-e713-445f-b56a-eec3bba2d6ae None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.407308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.408617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.409359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.410552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.411395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:41.411975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.416005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.435420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 815/1639] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:41.439325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.450661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391262-1a31-475d-a7aa-153d645a2686 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.459619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.461652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.462127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.463162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.465418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.469447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.475147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.477462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.492659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dccce0-aaec-43bb-8632-cc544b176e6d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.499724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.500394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.500730 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.501327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] PATH_INFO: `/v3/users/3e4975e3a3a64aae92dcb75ab2efaf9f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.502914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4975e3a3a64aae92dcb75ab2efaf9f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.513320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.517103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 825/1640] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:41 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:41.518190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.519963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.577722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4975e3a3a64aae92dcb75ab2efaf9f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.589862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122355-f5e9-445c-b8fc-b0ac0414470f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.596062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.596062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.596062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.596062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] PATH_INFO: `/v3/projects/a362efd215f045e6b5ec8071654f9a05` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.597075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a362efd215f045e6b5ec8071654f9a05)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.599094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.603047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4975e3a3a64aae92dcb75ab2efaf9f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.603905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4975e3a3a64aae92dcb75ab2efaf9f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.612440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4975e3a3a64aae92dcb75ab2efaf9f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.623005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4975e3a3a64aae92dcb75ab2efaf9f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.631686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 816/1641] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:41 2022] DELETE /identity/v3/users/3e4975e3a3a64aae92dcb75ab2efaf9f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:41.632625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.634835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.666834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a362efd215f045e6b5ec8071654f9a05', 'request_id': 'req-497b5567-c8d4-4f63-8b59-95cb8c88ef98'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.677453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a362efd215f045e6b5ec8071654f9a05', 'request_id': 'req-497b5567-c8d4-4f63-8b59-95cb8c88ef98'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.689241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a362efd215f045e6b5ec8071654f9a05', 'request_id': 'req-497b5567-c8d4-4f63-8b59-95cb8c88ef98'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.713731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] The token cache is being invalidate because project a362efd215f045e6b5ec8071654f9a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:41.714288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.714899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-497b5567-c8d4-4f63-8b59-95cb8c88ef98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.719346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 826/1642] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:41 2022] DELETE /identity/v3/projects/a362efd215f045e6b5ec8071654f9a05 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:41.719346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.719346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.719346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.729065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b53f-ac8d-49b5-9143-a2f62f34e018 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.756519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:41.757981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.789861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:41.803293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.803293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.803293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.803293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.803884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.807651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.842221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 827/1643] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:41.852906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 817/1644] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:41 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:41.853146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.854529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.854669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.855823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.862950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:41.871468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8b22d-292e-4398-a603-521bdd6a8dba None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.879800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.880570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.881043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.881979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] PATH_INFO: `/v3/users/6887455214cd4184bbb0cc1a5ad7690d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.883725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6887455214cd4184bbb0cc1a5ad7690d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.886691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.933686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a02a-cbb1-4d0a-bbe3-732923c12e26 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:41.937561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:41.938176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:41.939040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:41.939040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:41.944478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6887455214cd4184bbb0cc1a5ad7690d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.953147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:41.954577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:41.959231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6887455214cd4184bbb0cc1a5ad7690d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.960094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6887455214cd4184bbb0cc1a5ad7690d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.969382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6887455214cd4184bbb0cc1a5ad7690d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.977967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 818/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:41.979146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:41.980141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6887455214cd4184bbb0cc1a5ad7690d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:41.983112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:41.989615 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 828/1646] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:41 2022] DELETE /identity/v3/users/6887455214cd4184bbb0cc1a5ad7690d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:42.013415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11472da-0bf9-4db1-9527-15c4b8680d8b service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:42.162228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:42.162887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:42.163223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:42.163553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:42.164292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:42.166816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:42.218721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:42.219778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 819/1647] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:42.220413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.261667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152a8dd-615a-4aad-bf65-22426259d42c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:42.278737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:42.279516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:42.279897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:42.280263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:42.281054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:42.282899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:42.301004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:42.308838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 829/1648] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:05:42.312863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ee92-e592-4ec2-93cc-2dacdfdd538b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:42.319174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f93fe-e72a-44cc-b51c-b13994bd8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:42.320616 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f93fe-e72a-44cc-b51c-b13994bd8d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:42.321028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f93fe-e72a-44cc-b51c-b13994bd8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:42.321409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f93fe-e72a-44cc-b51c-b13994bd8d15 admin admin] PATH_INFO: `/v3/projects/1f99e504ed2b45e09426006be9d271a2/users/6f217d8aa8fc4e9292195f8ad624eca2/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:42.380496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f93fe-e72a-44cc-b51c-b13994bd8d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f99e504ed2b45e09426006be9d271a2, user_id=6f217d8aa8fc4e9292195f8ad624eca2, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:42.380496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f93fe-e72a-44cc-b51c-b13994bd8d15 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:42.381408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:42.385131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.400686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 820/1649] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:42 2022] PUT /identity/v3/projects/1f99e504ed2b45e09426006be9d271a2/users/6f217d8aa8fc4e9292195f8ad624eca2/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:42.405868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:42.406353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:42.407010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:42.452695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:42.456618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.482010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8320-8805-4007-8bfe-946d0802c2f4 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:42.569287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:42.570808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:42.571828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:42.571828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:42.572255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:42.574569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.585305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 821/1650] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:42.596856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:42.598340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.632044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:42.664194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:42.666067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:42.676454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 830/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:42.682366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673f74-a4b7-42a6-929f-6aa7f27e85db None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:42.686107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:42.686729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:42.687128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:42.687406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:42.699327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:42.700854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:42.717578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 822/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:42.950353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:42.951813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.964936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:42.966369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:42.991531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa2dd8-4a75-4b41-bfe1-67e00ab83d7d service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:42.994057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941438-4249-482b-9090-29aeb411ee73 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.001333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.002196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.002577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.002810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] PATH_INFO: `/v3/projects/6fc0722ea4e14d06a21dcf65a820950a` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.004109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc0722ea4e14d06a21dcf65a820950a)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.006048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.015199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.015900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.016306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.016812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] PATH_INFO: `/v3/projects/5a96dd1926884f0eb079b72930bfa0d8` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.018463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a96dd1926884f0eb079b72930bfa0d8)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.021763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.146790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a96dd1926884f0eb079b72930bfa0d8', 'request_id': 'req-6b07c94e-9279-4434-85c4-154a5ae80f89'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.158676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a96dd1926884f0eb079b72930bfa0d8', 'request_id': 'req-6b07c94e-9279-4434-85c4-154a5ae80f89'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.162275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc0722ea4e14d06a21dcf65a820950a', 'request_id': 'req-0f718357-c113-4611-85ec-16f1286ab9c7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.168315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a96dd1926884f0eb079b72930bfa0d8', 'request_id': 'req-6b07c94e-9279-4434-85c4-154a5ae80f89'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.175552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc0722ea4e14d06a21dcf65a820950a', 'request_id': 'req-0f718357-c113-4611-85ec-16f1286ab9c7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.183254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] The token cache is being invalidate because project 5a96dd1926884f0eb079b72930bfa0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:43.183676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.184708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc0722ea4e14d06a21dcf65a820950a', 'request_id': 'req-0f718357-c113-4611-85ec-16f1286ab9c7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.184831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.186672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 823/1653] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:42 2022] DELETE /identity/v3/projects/5a96dd1926884f0eb079b72930bfa0d8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:43.190269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:43.191925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.207698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] The token cache is being invalidate because project 6fc0722ea4e14d06a21dcf65a820950a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:43.208007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.208983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.211782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 831/1654] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:42 2022] DELETE /identity/v3/projects/6fc0722ea4e14d06a21dcf65a820950a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:43.212701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:43.214142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.309879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c94e-9279-4434-85c4-154a5ae80f89 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.316838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.317759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.318039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.318346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] PATH_INFO: `/v3/users/cd195798e2a2470387305cb5a1dd5331` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.319882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd195798e2a2470387305cb5a1dd5331)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.320476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f718357-c113-4611-85ec-16f1286ab9c7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.322352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.324785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.325460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.325742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.326019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] PATH_INFO: `/v3/users/d800e73b19994405ab77eacd76480f5e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.327171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d800e73b19994405ab77eacd76480f5e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.330217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.376743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:43.415089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd800e73b19994405ab77eacd76480f5e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.418235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd195798e2a2470387305cb5a1dd5331'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.432870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:43.442101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd195798e2a2470387305cb5a1dd5331'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.442848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd800e73b19994405ab77eacd76480f5e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.443497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd195798e2a2470387305cb5a1dd5331'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.444902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd800e73b19994405ab77eacd76480f5e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.464541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd800e73b19994405ab77eacd76480f5e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.465928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b796b6cb-627a-4472-a126-0e9e947b906f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd800e73b19994405ab77eacd76480f5e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.471525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd195798e2a2470387305cb5a1dd5331'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.490197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e267eea0-287d-4e4a-8556-a84c770874b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd195798e2a2470387305cb5a1dd5331'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:43.491104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 832/1655] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:43 2022] DELETE /identity/v3/users/d800e73b19994405ab77eacd76480f5e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:43.493065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278ed8f-0d6f-435d-b368-349b6684c90b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.493342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278ed8f-0d6f-435d-b368-349b6684c90b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.493614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278ed8f-0d6f-435d-b368-349b6684c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.519167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 824/1656] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:43 2022] DELETE /identity/v3/users/cd195798e2a2470387305cb5a1dd5331 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:43.520850 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.521311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.521735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.537588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f278ed8f-0d6f-435d-b368-349b6684c90b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:43.539360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f278ed8f-0d6f-435d-b368-349b6684c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.566694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:43.568186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.666875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 833/1657] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:43.675528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.676133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.676133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.712989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 825/1658] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:43.721812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:43.724607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.728059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:43.729697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.744633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 834/1659] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:43.749502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:43.760244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0060df-018a-41fd-8f93-e6755dba20b8 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.765937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.766564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.766839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.767103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.767893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:43.768196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.770901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.794538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 835/1660] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:43.797045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:43.815143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ede6a-4155-4721-b567-516969948861 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.825309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1b0dd-b673-4cf9-8c0c-5ce610389e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.826795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b0dd-b673-4cf9-8c0c-5ce610389e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.827156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b0dd-b673-4cf9-8c0c-5ce610389e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.827514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b0dd-b673-4cf9-8c0c-5ce610389e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.828157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b0dd-b673-4cf9-8c0c-5ce610389e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.830190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b0dd-b673-4cf9-8c0c-5ce610389e3b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.862334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a888e0-684e-4c1f-9d76-f4da91ed1111 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.869447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:43.870404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.870829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.871278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.881342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:43.884794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:43.887085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 836/1661] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:43 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:43.888624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:43.889105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:43.889488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:43.903179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 826/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:05:43.904104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:43.919038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b605bc-d483-44ae-883e-8a6cda5323c6 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:43.951696 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] MFA Rules not processed for user `6f217d8aa8fc4e9292195f8ad624eca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:43.953178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:43.990274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:44.015698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.017271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.018666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.018970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.022062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.041733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.104542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 827/1663] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:43 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:44.107189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.110236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.128641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2c1fe-7fc4-4f09-af04-15f8e4d93328 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.134378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.135705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.135998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.136314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] PATH_INFO: `/v3/projects/8cbe2c6af48c43e2bf8853384804a313` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.137465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbe2c6af48c43e2bf8853384804a313)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.139358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.145847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 837/1664] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:44.146594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.166222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9e05-5287-4380-8283-e13f1a2a9574 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.172772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.173600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.173828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.174269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.175068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.177162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.196792 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 838/1665] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:44.198101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.200281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.225918 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:44.271141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbe2c6af48c43e2bf8853384804a313', 'request_id': 'req-bc47232a-311d-40df-bf63-e36055629a69'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.305176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbe2c6af48c43e2bf8853384804a313', 'request_id': 'req-bc47232a-311d-40df-bf63-e36055629a69'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.311808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbe2c6af48c43e2bf8853384804a313', 'request_id': 'req-bc47232a-311d-40df-bf63-e36055629a69'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.324914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] The token cache is being invalidate because project 8cbe2c6af48c43e2bf8853384804a313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:44.325542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.326011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.327034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298c707-ceff-47cb-872c-c244efffea9e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.331022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 828/1666] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:44 2022] DELETE /identity/v3/projects/8cbe2c6af48c43e2bf8853384804a313 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:44.331022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.331022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.405504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.406128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.406448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.406740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.410050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.418351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47232a-311d-40df-bf63-e36055629a69 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.436827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071b7d9-c164-4448-84e6-d9d4be2c4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.438362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071b7d9-c164-4448-84e6-d9d4be2c4352 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.438895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071b7d9-c164-4448-84e6-d9d4be2c4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.440441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071b7d9-c164-4448-84e6-d9d4be2c4352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.441344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071b7d9-c164-4448-84e6-d9d4be2c4352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.449465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071b7d9-c164-4448-84e6-d9d4be2c4352 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.473517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 829/1667] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:44.475086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.475384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.475657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.483082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.484818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.494858 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 839/1668] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:44.495637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.496871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:44.496982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.498064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.509011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 830/1669] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:44.509011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.513933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33cf90-47a3-4428-9a06-a7dc30d496e2 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.518207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74159b-1311-43b8-ad73-7bf6b422975c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.518750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.519382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.519808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.520123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] PATH_INFO: `/v3/projects/cb426d8c1ab04a1ab0c7be3579e3c6ac` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.521232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb426d8c1ab04a1ab0c7be3579e3c6ac)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.523799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.523907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99f96f-1f79-4f0d-b31c-be3224132cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.524505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f96f-1f79-4f0d-b31c-be3224132cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.524788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f96f-1f79-4f0d-b31c-be3224132cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.525062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f96f-1f79-4f0d-b31c-be3224132cac admin admin] PATH_INFO: `/v3/projects/4b0f9793aaf3414da5475520af5e85c7/users/573a2879a1684691831a7f1cb991de6b/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.541474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f96f-1f79-4f0d-b31c-be3224132cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0f9793aaf3414da5475520af5e85c7, user_id=573a2879a1684691831a7f1cb991de6b, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.544120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f96f-1f79-4f0d-b31c-be3224132cac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.559651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 831/1670] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:44 2022] PUT /identity/v3/projects/4b0f9793aaf3414da5475520af5e85c7/users/573a2879a1684691831a7f1cb991de6b/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:44.561220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.561488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.561759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.585456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb426d8c1ab04a1ab0c7be3579e3c6ac', 'request_id': 'req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.588212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:44.589476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.596297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb426d8c1ab04a1ab0c7be3579e3c6ac', 'request_id': 'req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.604730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb426d8c1ab04a1ab0c7be3579e3c6ac', 'request_id': 'req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.609964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:44.617977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] The token cache is being invalidate because project cb426d8c1ab04a1ab0c7be3579e3c6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:44.618197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.618924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0ed8514c-8a22-4a1f-b28c-b0d70e7181a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.620699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 840/1671] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:44 2022] DELETE /identity/v3/projects/cb426d8c1ab04a1ab0c7be3579e3c6ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:44.621954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.622136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.622361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.641261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:44.664942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] MFA Rules not processed for user `573a2879a1684691831a7f1cb991de6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:44.666226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.678889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 832/1672] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:44.686086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.689183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.702618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc786008-6886-49c2-ad8e-bebba77922c4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.709281 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.709977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.710257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.711268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] PATH_INFO: `/v3/users/1254ca5301f442a38d4c7e147044041a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.712550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1254ca5301f442a38d4c7e147044041a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.714712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.761959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 841/1673] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:44.762868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.774988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb1ab-4aa7-42a6-8bcf-a809ffd3fcb1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:44.779992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:44.780711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:44.781004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:44.781253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:44.781899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:44.782205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:44.783786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:44.800245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1254ca5301f442a38d4c7e147044041a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.813748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 842/1674] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:44.814658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.825269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1254ca5301f442a38d4c7e147044041a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.825491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.826473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1254ca5301f442a38d4c7e147044041a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.853469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1254ca5301f442a38d4c7e147044041a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.864307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1254ca5301f442a38d4c7e147044041a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:44.874535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 833/1675] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:44 2022] DELETE /identity/v3/users/1254ca5301f442a38d4c7e147044041a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:44.878528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:44.881934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:44.916361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6ddde-ea86-4184-8d44-72c40160f35d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.013400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.014247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.014750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.015148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.022083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.044970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d8f51-7313-4c15-b698-10aec5091847 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.052510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.053479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.054445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.055139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.056038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.058440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.093089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:45.099959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.103098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.118889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 843/1676] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:45.131583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 834/1677] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:44 2022] POST /identity/v3/projects => generated 361 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:45.137409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.157075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2380-b4c9-4c0d-8971-e18c195f8c70 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.274108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.276012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.280377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.281227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.282051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.282678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.287519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.291992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.312311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aabbe-d702-4b11-bf15-1126d46f41ac admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.319179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.320199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.320520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.320800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] PATH_INFO: `/v3/projects/cea13110a6a241c09e56035ac224486e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.322272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea13110a6a241c09e56035ac224486e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.324639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.328162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 844/1678] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:45 2022] POST /identity/v3/users => generated 281 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:45.332179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.345363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dd37b-62ae-46bc-8db6-b9496b8779f0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.352582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.353475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.353584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:45.354648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.355136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.356223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.358427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.375530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 845/1679] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:05:45.380031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.395240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976dc24-b1c4-409b-9ead-2ae3ed8dca32 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.413804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea13110a6a241c09e56035ac224486e', 'request_id': 'req-e7b504d7-aa21-48fa-9fca-0a05bf81f036'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.433166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea13110a6a241c09e56035ac224486e', 'request_id': 'req-e7b504d7-aa21-48fa-9fca-0a05bf81f036'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.448977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea13110a6a241c09e56035ac224486e', 'request_id': 'req-e7b504d7-aa21-48fa-9fca-0a05bf81f036'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.466063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] The token cache is being invalidate because project cea13110a6a241c09e56035ac224486e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:45.466571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.467250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7b504d7-aa21-48fa-9fca-0a05bf81f036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.472224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 835/1680] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:45 2022] DELETE /identity/v3/projects/cea13110a6a241c09e56035ac224486e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:45.473755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dbb0d-d2de-4383-a798-10e2754d9a69 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.474084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dbb0d-d2de-4383-a798-10e2754d9a69 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.474411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dbb0d-d2de-4383-a798-10e2754d9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.492660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.493723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.493997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.494272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.495026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.498209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.510271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-067dbb0d-d2de-4383-a798-10e2754d9a69 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:45.512865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-067dbb0d-d2de-4383-a798-10e2754d9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.517648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 846/1681] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:45.521559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.524446 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.533060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 836/1682] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:45.545355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.545645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.550294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.573232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede3299-481a-4b66-bcf6-4432c576a9a8 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.587333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.589169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.590139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.591373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] PATH_INFO: `/v3/projects/fe9a1551e7fe473290b40048dd94b295/users/5a6dbc0bfa1542fd9faba54ff02f4b43/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.599889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:45.604702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.629405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 837/1683] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:45.634390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.637538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9a1551e7fe473290b40048dd94b295, user_id=5a6dbc0bfa1542fd9faba54ff02f4b43, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.640498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.652874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab665f-8040-49e9-87d8-39a46f0b9bd3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.663230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.665098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.665487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.665844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.666776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:45.667148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.667840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 847/1684] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:45 2022] PUT /identity/v3/projects/fe9a1551e7fe473290b40048dd94b295/users/5a6dbc0bfa1542fd9faba54ff02f4b43/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:45.668722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.669670 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c2e0a-2069-4226-a906-ce890bb4c3f3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.673113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.702243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 838/1685] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:45.703674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.703934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.704229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.750785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] MFA Rules not processed for user `5a6dbc0bfa1542fd9faba54ff02f4b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:45.752028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:45.756742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:45.816902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022516a6-5556-42c5-8f8d-eec89b1f8c27 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.841086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.843513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.844002 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.844406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] PATH_INFO: `/v3/users/8c2a5e6ee78c4925b5dd98771c604b37` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.845705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2a5e6ee78c4925b5dd98771c604b37)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.851110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.854420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 839/1686] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:45.855137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.869099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65aefd-e240-4037-8beb-b250c78cd365 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:45.875288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:45.876024 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:45.876316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:45.876625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:45.877378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:45.886970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:45.963803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2a5e6ee78c4925b5dd98771c604b37'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.975441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 840/1687] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:45 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:45.975441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:45.985152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2a5e6ee78c4925b5dd98771c604b37'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.986069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2a5e6ee78c4925b5dd98771c604b37'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:45.996231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2a5e6ee78c4925b5dd98771c604b37'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:46.010097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2a5e6ee78c4925b5dd98771c604b37'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:46.020189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 848/1688] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:45 2022] DELETE /identity/v3/users/8c2a5e6ee78c4925b5dd98771c604b37 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:46.024708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.027881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:46.065537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:46.085369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253038b-7595-4888-963f-19ab1b1f3fa4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.141649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d5f85-3838-473e-bd02-b25e757935c0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.164391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d802ba-afbb-44f6-bad4-6a97c3c7e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.165940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d802ba-afbb-44f6-bad4-6a97c3c7e022 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.166490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d802ba-afbb-44f6-bad4-6a97c3c7e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.167343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d802ba-afbb-44f6-bad4-6a97c3c7e022 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.168187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d802ba-afbb-44f6-bad4-6a97c3c7e022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.170502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d802ba-afbb-44f6-bad4-6a97c3c7e022 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.188889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1f21d-27af-4d50-81fa-31c31eb196d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.189594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1f21d-27af-4d50-81fa-31c31eb196d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.189955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1f21d-27af-4d50-81fa-31c31eb196d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.190237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1f21d-27af-4d50-81fa-31c31eb196d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.191080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1f21d-27af-4d50-81fa-31c31eb196d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.193045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1f21d-27af-4d50-81fa-31c31eb196d3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.209574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 849/1689] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:46.211977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.212445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.212956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.233348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 841/1690] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:45 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:46.235277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.235667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.236136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.239121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:46.242236 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:46.262063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] MFA Rules not processed for user `6f217d8aa8fc4e9292195f8ad624eca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:46.263404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:46.309008 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:46.333675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 850/1691] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:46.334807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.351564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256ab18-a6cc-4d01-bae0-8ec841c7b5c6 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.367421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 842/1692] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:46.367421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.367421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:46.370750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.370750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.370750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.370750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.371087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.372809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.386779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bf007-0965-4b72-9c59-10e14d5af9de None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.391849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.392500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.392785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.393066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.393996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.394475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 851/1693] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:46.395716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.395916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.398018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:46.425816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 843/1694] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/users => generated 289 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:46.426657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.448045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d7d9c-fc7d-446f-acae-3eb9557525f6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.484199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.484854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.485134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.485404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.486055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.487953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.505555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 844/1695] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:46.506228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.518012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83936689-c4af-4ad1-b33c-06f996900f34 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.522922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.524079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.524453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.524729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.525372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.527157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.532371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073aa49-721f-4e10-b94d-25aa893fa7bd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.537451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.538345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.539399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.539874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.539980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 845/1696] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:46.540800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.550568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb403-56d5-4f00-b870-156cdf0ef129 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.554518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.555519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86de4ba-5311-466e-b5c7-85ab2cef6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.556184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de4ba-5311-466e-b5c7-85ab2cef6300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.556396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.556519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de4ba-5311-466e-b5c7-85ab2cef6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.556782 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de4ba-5311-466e-b5c7-85ab2cef6300 admin admin] PATH_INFO: `/v3/projects/7cad4142c0924ff18fd786a40ad0330d/users/98574b4da9564d97a309de43f443fe2e/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.572510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 852/1697] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:46.573841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.576628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86de4ba-5311-466e-b5c7-85ab2cef6300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cad4142c0924ff18fd786a40ad0330d, user_id=98574b4da9564d97a309de43f443fe2e, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.579600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86de4ba-5311-466e-b5c7-85ab2cef6300 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.585057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06140-d2b1-4c8d-8cc3-94704f3e0653 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.591925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.592764 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.593078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.593354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] PATH_INFO: `/v3/projects/c56964e3dfcc4418b88f527acae478c2/users/620674c0fdf641dfa459456306e9e6f5/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.597019 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 846/1698] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:46 2022] PUT /identity/v3/projects/7cad4142c0924ff18fd786a40ad0330d/users/98574b4da9564d97a309de43f443fe2e/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:46.610334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.611390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.612101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.623853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56964e3dfcc4418b88f527acae478c2, user_id=620674c0fdf641dfa459456306e9e6f5, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.626982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.653078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] MFA Rules not processed for user `98574b4da9564d97a309de43f443fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:46.654594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:46.658581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 853/1699] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:46 2022] PUT /identity/v3/projects/c56964e3dfcc4418b88f527acae478c2/users/620674c0fdf641dfa459456306e9e6f5/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:46.662563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.666171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:46.757494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 847/1700] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:46.762741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.827575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16373-dd03-4d91-9717-39c12a493f95 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.844770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.846213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.846945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.847433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.851300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.868187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.886800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 854/1701] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:46.891320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:46.911127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1981fa-3a0b-4d7f-a74c-0e8ceb1b6d56 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.921750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ab40-64e7-4d95-b19e-96320bd04bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:46.923074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ab40-64e7-4d95-b19e-96320bd04bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.923879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ab40-64e7-4d95-b19e-96320bd04bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.924750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ab40-64e7-4d95-b19e-96320bd04bb5 admin admin] PATH_INFO: `/v3/projects/c56964e3dfcc4418b88f527acae478c2/users/620674c0fdf641dfa459456306e9e6f5/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:46.929163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182ab40-64e7-4d95-b19e-96320bd04bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56964e3dfcc4418b88f527acae478c2, user_id=620674c0fdf641dfa459456306e9e6f5, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:46.932683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182ab40-64e7-4d95-b19e-96320bd04bb5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:46.948751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 855/1702] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:46 2022] PUT /identity/v3/projects/c56964e3dfcc4418b88f527acae478c2/users/620674c0fdf641dfa459456306e9e6f5/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:46.957451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58902e5-8f9a-4ad6-b264-7e3ce333a8cc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:46.959156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:46.959591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:46.960048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.068832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] MFA Rules not processed for user `620674c0fdf641dfa459456306e9e6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:47.068832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:47.089183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.090642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.091201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.091674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.092563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.094966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.128448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:47.148877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 848/1703] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/projects => generated 377 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:47.150367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.192927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 856/1704] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:47.210406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:47.216861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.221534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:47.245673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da334c92-97e7-42ad-8453-14287dc803bb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.258220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.258647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.258927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.259204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.259847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.261869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.305098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1868a-dcd6-4ae8-9249-282c6a066dc9 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.307361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 849/1705] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:47 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:47.311653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.339853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113423d-1cc8-4cc9-8a2b-6532290fd35e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.347888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.348668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.348995 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.349653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.350819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.353671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.401782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d624-5f31-46da-9cf6-fb801e20d8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.402483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d624-5f31-46da-9cf6-fb801e20d8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.402767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d624-5f31-46da-9cf6-fb801e20d8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.403072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d624-5f31-46da-9cf6-fb801e20d8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.414540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 850/1706] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:47.418050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.437388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6305-8c51-451c-8ac0-b967a5ed7150 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.452222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.452909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.453230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.453505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.454192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.456422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.473346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 851/1707] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:47.489688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.516909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920d624-5f31-46da-9cf6-fb801e20d8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.518787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920d624-5f31-46da-9cf6-fb801e20d8b3 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.528764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3940-b0f4-4d1c-bce4-392ecda239c8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.536491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 857/1708] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:47.547331 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.551136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.551500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.552509 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] PATH_INFO: `/v3/projects/f62e522041484866b3c9c3d2def7b8df/users/9887387cadd74b328d72f4ade4720cab/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.597858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62e522041484866b3c9c3d2def7b8df, user_id=9887387cadd74b328d72f4ade4720cab, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.600589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.632757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 852/1709] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:47 2022] PUT /identity/v3/projects/f62e522041484866b3c9c3d2def7b8df/users/9887387cadd74b328d72f4ade4720cab/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:47.644996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.645291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.645570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.655147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.703857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] MFA Rules not processed for user `9887387cadd74b328d72f4ade4720cab`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:47.705399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:47.732345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689b16-90e0-4e77-b359-6596b9cccb25 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.737014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.737710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.738088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.738425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.738636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:47.740744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:47.806514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 858/1710] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:47.808460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.894065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.895437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:47.911425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 853/1711] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:47.923766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:47.925266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:47.953174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28427-25ff-4f00-b377-24425bf4876f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:47.964656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:47.965468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:47.965749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:47.966180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:47.966970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:47.971613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.058018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:48.082772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 859/1712] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:47 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:48.088041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:48.104480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced109e-fd4e-4370-abd2-2948901a8f4e service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.175330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993be61-aaec-4a63-8d2b-ccdf0acc3005 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.182312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.183368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.183795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.184208 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.185013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.187803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.220089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.221436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.221922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.222520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] PATH_INFO: `/v3/projects/d70fba30f20340668e2c9523222afe6b` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.225288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70fba30f20340668e2c9523222afe6b)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.229728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.233794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 860/1713] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:48 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:05:48.238310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:48.260622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9d5c-05e1-4410-8f09-90d5418ecd06 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.275678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.276309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.276692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.278640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.279835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.283922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.307930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 861/1714] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:48.312015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:48.331667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3590-da8e-479f-b899-a1ee86064ca0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.357208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70fba30f20340668e2c9523222afe6b', 'request_id': 'req-e473fcad-93f7-4923-b1f3-2bc1be0933d6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.376088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70fba30f20340668e2c9523222afe6b', 'request_id': 'req-e473fcad-93f7-4923-b1f3-2bc1be0933d6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.387175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70fba30f20340668e2c9523222afe6b', 'request_id': 'req-e473fcad-93f7-4923-b1f3-2bc1be0933d6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.401992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:48.405991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] The token cache is being invalidate because project d70fba30f20340668e2c9523222afe6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:48.406292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.407216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.411797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 854/1715] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:47 2022] DELETE /identity/v3/projects/d70fba30f20340668e2c9523222afe6b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:48.413781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:48.418650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:48.492694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.493624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.493751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.494383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] PATH_INFO: `/v3/projects/67317f45255e4140ab8cc39329e22a31/users/e843b38da7ea4cc3a7d63908dab4d1fd/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.542772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67317f45255e4140ab8cc39329e22a31, user_id=e843b38da7ea4cc3a7d63908dab4d1fd, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.554068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.576640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 862/1716] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:48 2022] PUT /identity/v3/projects/67317f45255e4140ab8cc39329e22a31/users/e843b38da7ea4cc3a7d63908dab4d1fd/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:48.579619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:48.588912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:48.589436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473fcad-93f7-4923-b1f3-2bc1be0933d6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.644950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:48.702322 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.703520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.704219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.704964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] PATH_INFO: `/v3/users/3661ee4a43d943608d20abbd70649148` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.706577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3661ee4a43d943608d20abbd70649148)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.708958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.726599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447029dd-1634-4689-9a7f-f924bc42ec6b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.732158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.732926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.733346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.733940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.734785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.736929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.749448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 863/1717] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:48.756530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:48.778145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b70f9-eb4b-4528-96fe-eafa8c81d7cf admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:48.778665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3661ee4a43d943608d20abbd70649148'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.785014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982173a-09fc-47e6-bcb3-e4a4371dde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:48.786076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982173a-09fc-47e6-bcb3-e4a4371dde04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.786403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982173a-09fc-47e6-bcb3-e4a4371dde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.787034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982173a-09fc-47e6-bcb3-e4a4371dde04 admin admin] PATH_INFO: `/v3/projects/67317f45255e4140ab8cc39329e22a31/users/e843b38da7ea4cc3a7d63908dab4d1fd/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.789962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982173a-09fc-47e6-bcb3-e4a4371dde04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67317f45255e4140ab8cc39329e22a31, user_id=e843b38da7ea4cc3a7d63908dab4d1fd, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:48.793454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982173a-09fc-47e6-bcb3-e4a4371dde04 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:48.796092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3661ee4a43d943608d20abbd70649148'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.797857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3661ee4a43d943608d20abbd70649148'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.811348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 864/1718] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:48 2022] PUT /identity/v3/projects/67317f45255e4140ab8cc39329e22a31/users/e843b38da7ea4cc3a7d63908dab4d1fd/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:48.821406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3661ee4a43d943608d20abbd70649148'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.824060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:48.824368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:48.824644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:48.825593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3661ee4a43d943608d20abbd70649148'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:48.847111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 855/1719] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:48 2022] DELETE /identity/v3/users/3661ee4a43d943608d20abbd70649148 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:48.862009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] MFA Rules not processed for user `e843b38da7ea4cc3a7d63908dab4d1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:48.863242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:48.988711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 865/1720] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:49.001208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:49.003016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:49.082850 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8da9-1ef3-415b-bd4f-87aa802798ac admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:49.088129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:49.088671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:49.089068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:49.093516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:49.103642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:49.105355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:49.116209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 856/1721] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:49.162995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:49.165182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:49.177061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6384b1-67a0-4365-891e-f961f90f9e19 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:49.180988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:49.181617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:49.181927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:49.182198 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:49.183990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:49.208369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:49.267662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:49.269954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:49.272623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:49.275274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:49.292121 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 866/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:49.354580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:49.381645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766438-06d8-4d28-b912-a6bbe9871205 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:49.386436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:49.387083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:49.387364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:49.387640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] PATH_INFO: `/v3/projects/03b433d976014997944f29dd22ca3d1b` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:49.388808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b433d976014997944f29dd22ca3d1b)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:49.390832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:49.461396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b433d976014997944f29dd22ca3d1b', 'request_id': 'req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.472684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b433d976014997944f29dd22ca3d1b', 'request_id': 'req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.482511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b433d976014997944f29dd22ca3d1b', 'request_id': 'req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.500023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] The token cache is being invalidate because project 03b433d976014997944f29dd22ca3d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:49.501036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.501965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.504951 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 857/1723] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:49 2022] DELETE /identity/v3/projects/03b433d976014997944f29dd22ca3d1b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:49.509418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:49.523857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bbe3e-ebbd-41c6-8d31-15cdb450849c service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:49.598882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:49.599800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:49.600288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:49.600833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] PATH_INFO: `/v3/users/5b1f645816bd4765908ef5477d52489d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:49.602987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1f645816bd4765908ef5477d52489d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:49.607183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:49.686994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1f645816bd4765908ef5477d52489d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.727842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1f645816bd4765908ef5477d52489d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.728646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1f645816bd4765908ef5477d52489d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.742077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1f645816bd4765908ef5477d52489d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.771501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3debcc4c-331b-4fdd-8a92-5e4d113aea6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1f645816bd4765908ef5477d52489d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:49.789477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 867/1724] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:49 2022] DELETE /identity/v3/users/5b1f645816bd4765908ef5477d52489d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:50.453124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:50.455462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:50.471954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f5d9-d9a1-4ddd-9b64-e049c7dcb271 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:50.544243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:50.544950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:50.545337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:50.546289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] PATH_INFO: `/v3/projects/81f20a37da73473786c89407ef369d70` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:50.546798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f20a37da73473786c89407ef369d70)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:50.548797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:50.599216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f20a37da73473786c89407ef369d70', 'request_id': 'req-677fd4df-00f2-4403-9d10-e51b4935bc82'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:50.608598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f20a37da73473786c89407ef369d70', 'request_id': 'req-677fd4df-00f2-4403-9d10-e51b4935bc82'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:50.615124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f20a37da73473786c89407ef369d70', 'request_id': 'req-677fd4df-00f2-4403-9d10-e51b4935bc82'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:50.626449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] The token cache is being invalidate because project 81f20a37da73473786c89407ef369d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:50.626740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:50.627410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-677fd4df-00f2-4403-9d10-e51b4935bc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:50.630511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 858/1725] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:50 2022] DELETE /identity/v3/projects/81f20a37da73473786c89407ef369d70 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:50.635557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:50.636065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:50.636156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:50.655761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:50.657001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:50.691804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:50.723966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 868/1726] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:50.733820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:50.734108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:50.734383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:50.753693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:50.765531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:50.767432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:50.776728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 859/1727] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:50.781297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:50.792902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8c49d-75ea-4463-9abb-d75389fe496c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:50.814621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:50.815529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:50.816709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:50.817396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:50.817689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:50.818818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:50.819794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:50.834588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 869/1728] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:50.839357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:50.870278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19123b6f-e460-45b6-9ee9-8faaa3593601 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:50.877790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:50.878446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:50.878807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:50.878979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:50.880050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:50.882111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:50.932920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 860/1729] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:50 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:50.934610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:50.954980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473ec5e-ece7-4ef2-95eb-412e42bf3be3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:51.133590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:51.134221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:51.134499 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:51.134769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:51.135409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:51.137403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:51.177725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 870/1730] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:50 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:51.180087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:51.204088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c61e-9999-4fbf-9202-3e45e549cff9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:51.227504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:51.229620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:51.231391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:51.231574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:51.247427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:51.254940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:51.286550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 861/1731] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:51.287306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:51.298046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827a7f-126d-466d-9312-f4b5aa3dc981 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:51.313609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77bdca-cc79-49bc-90ad-24f2af4b702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:51.314403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77bdca-cc79-49bc-90ad-24f2af4b702c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:51.314683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77bdca-cc79-49bc-90ad-24f2af4b702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:51.315800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77bdca-cc79-49bc-90ad-24f2af4b702c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:51.316511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77bdca-cc79-49bc-90ad-24f2af4b702c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:51.318444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77bdca-cc79-49bc-90ad-24f2af4b702c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:51.334376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 871/1732] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:05:51.338282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:51.350346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7a44-ec30-45cc-9ea9-a9b0c10cb2ba admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:51.356804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:51.357641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:51.357994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:51.358337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] PATH_INFO: `/v3/projects/c42595be79b448159149cb7663e79cb9/users/90f11f0d98aa4ec0bd966fdb8c3a5442/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:51.379316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42595be79b448159149cb7663e79cb9, user_id=90f11f0d98aa4ec0bd966fdb8c3a5442, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:51.383770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:51.406099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 862/1733] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:51 2022] PUT /identity/v3/projects/c42595be79b448159149cb7663e79cb9/users/90f11f0d98aa4ec0bd966fdb8c3a5442/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:51.418859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:51.419256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:51.419710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:51.472474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] MFA Rules not processed for user `90f11f0d98aa4ec0bd966fdb8c3a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:51.473728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:51.600214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 872/1734] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:51.619176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:51.621555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:51.836327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3c689-cb98-42ac-8e90-c924a34cd62e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:51.848992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95858-5e33-40ef-b6c0-dc354d0a04f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:51.853346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95858-5e33-40ef-b6c0-dc354d0a04f6 service glance] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:51.853866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95858-5e33-40ef-b6c0-dc354d0a04f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:51.855627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95858-5e33-40ef-b6c0-dc354d0a04f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:51.872711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b95858-5e33-40ef-b6c0-dc354d0a04f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:51.874770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b95858-5e33-40ef-b6c0-dc354d0a04f6 service glance] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:51.890624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 863/1735] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:53.717993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:53.719489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:53.753782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:53.790546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbc024-7380-46f1-a5a6-6c1d37c5b111 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:53.796068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:53.796743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:53.797036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:53.797295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] PATH_INFO: `/v3/users/98574b4da9564d97a309de43f443fe2e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:53.798432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98574b4da9564d97a309de43f443fe2e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:53.800360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:53.862044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98574b4da9564d97a309de43f443fe2e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:53.875987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98574b4da9564d97a309de43f443fe2e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:53.877101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98574b4da9564d97a309de43f443fe2e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:53.887253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98574b4da9564d97a309de43f443fe2e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:53.903586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98574b4da9564d97a309de43f443fe2e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:53.917831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 873/1736] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:53 2022] DELETE /identity/v3/users/98574b4da9564d97a309de43f443fe2e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:53.922266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:53.922852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:53.922852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:53.943515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:53.945438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:54.029526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 864/1737] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:54.041856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:54.045132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:54.144299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852981-f234-4069-984c-120da83f7876 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:54.149003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:54.149707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:54.150082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:54.150522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:54.160966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:54.162506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:54.175134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 874/1738] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:54.513204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:54.514921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:54.528194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a55d-1db7-4ad9-813d-78b73021159f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:54.539189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:54.539884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:54.540165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:54.540465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] PATH_INFO: `/v3/projects/7cad4142c0924ff18fd786a40ad0330d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:54.541657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cad4142c0924ff18fd786a40ad0330d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:54.543513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:54.569155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:54.594724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cad4142c0924ff18fd786a40ad0330d', 'request_id': 'req-756fc6f1-5d6e-41b8-9e6d-48dea668414d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.603251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cad4142c0924ff18fd786a40ad0330d', 'request_id': 'req-756fc6f1-5d6e-41b8-9e6d-48dea668414d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.610514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cad4142c0924ff18fd786a40ad0330d', 'request_id': 'req-756fc6f1-5d6e-41b8-9e6d-48dea668414d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.623948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] The token cache is being invalidate because project 7cad4142c0924ff18fd786a40ad0330d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:54.624279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.624885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.626408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 865/1739] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:54 2022] DELETE /identity/v3/projects/7cad4142c0924ff18fd786a40ad0330d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:54.630934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:54.640866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377e9b4-72a4-4284-8c76-58ce377ad713 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:54.711127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:54.724406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:54.725262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:54.725579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:54.725752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] PATH_INFO: `/v3/users/9887387cadd74b328d72f4ade4720cab` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:54.729954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9887387cadd74b328d72f4ade4720cab)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:54.731915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:54.816154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9887387cadd74b328d72f4ade4720cab'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.832679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9887387cadd74b328d72f4ade4720cab'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.833772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9887387cadd74b328d72f4ade4720cab'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.844994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9887387cadd74b328d72f4ade4720cab'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.856013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9887387cadd74b328d72f4ade4720cab'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:54.875675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 875/1740] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:54 2022] DELETE /identity/v3/users/9887387cadd74b328d72f4ade4720cab => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:55.391203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:55.392781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:55.408264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fc6f1-5d6e-41b8-9e6d-48dea668414d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:55.498674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:55.499771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:55.500052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:55.500319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] PATH_INFO: `/v3/projects/f62e522041484866b3c9c3d2def7b8df` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:55.501627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62e522041484866b3c9c3d2def7b8df)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:55.504728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:55.561086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62e522041484866b3c9c3d2def7b8df', 'request_id': 'req-2137e72f-474a-4eac-acd6-e41d538f319f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.570865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62e522041484866b3c9c3d2def7b8df', 'request_id': 'req-2137e72f-474a-4eac-acd6-e41d538f319f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.579953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62e522041484866b3c9c3d2def7b8df', 'request_id': 'req-2137e72f-474a-4eac-acd6-e41d538f319f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.595639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] The token cache is being invalidate because project f62e522041484866b3c9c3d2def7b8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:55.596288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.597105 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.599301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 866/1741] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:55 2022] DELETE /identity/v3/projects/f62e522041484866b3c9c3d2def7b8df => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:55.603927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:55.606423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:55.619368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:55.621026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:55.621739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24e871-68b7-45f5-88b1-2439c4505744 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:55.674934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:55.700200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:55.700981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:55.701259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:55.701532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] PATH_INFO: `/v3/users/e843b38da7ea4cc3a7d63908dab4d1fd` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:55.702659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e843b38da7ea4cc3a7d63908dab4d1fd)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:55.704393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e72f-474a-4eac-acd6-e41d538f319f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:55.704942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:55.713025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:55.713025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:55.713025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:55.713025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] PATH_INFO: `/v3/users/5a6dbc0bfa1542fd9faba54ff02f4b43` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:55.713463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6dbc0bfa1542fd9faba54ff02f4b43)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:55.715405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:55.766772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e843b38da7ea4cc3a7d63908dab4d1fd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.771579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6dbc0bfa1542fd9faba54ff02f4b43'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.781633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e843b38da7ea4cc3a7d63908dab4d1fd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.782536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e843b38da7ea4cc3a7d63908dab4d1fd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.792571 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e843b38da7ea4cc3a7d63908dab4d1fd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.796206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:55.797385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6dbc0bfa1542fd9faba54ff02f4b43'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.798265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6dbc0bfa1542fd9faba54ff02f4b43'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.803014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-26465d13-69f5-4ae2-b6ed-68d9bd704294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e843b38da7ea4cc3a7d63908dab4d1fd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.808160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6dbc0bfa1542fd9faba54ff02f4b43'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.814270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 876/1742] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:55 2022] DELETE /identity/v3/users/e843b38da7ea4cc3a7d63908dab4d1fd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:55.819002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6dbc0bfa1542fd9faba54ff02f4b43'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:55.826866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 867/1743] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:55 2022] DELETE /identity/v3/users/5a6dbc0bfa1542fd9faba54ff02f4b43 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:55.831295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:55.831584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:55.831860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:55.853467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:55.854712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:55.947811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 877/1744] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:55.969124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:55.970614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.046834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86dd2-31fe-48f4-9aed-ddb99ed92054 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:56.057650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddd650-fd8b-4879-bc76-f26fddc94f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:56.058586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddd650-fd8b-4879-bc76-f26fddc94f90 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.059073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddd650-fd8b-4879-bc76-f26fddc94f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.059529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddd650-fd8b-4879-bc76-f26fddc94f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.074489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddd650-fd8b-4879-bc76-f26fddc94f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:56.076028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddd650-fd8b-4879-bc76-f26fddc94f90 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:56.088209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 868/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:56.370673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:56.372165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.401339 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3859a-70dd-4b7e-a9ec-897cc1ad86b1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:56.406229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:56.406883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.407161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.407443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] PATH_INFO: `/v3/projects/67317f45255e4140ab8cc39329e22a31` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.408612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67317f45255e4140ab8cc39329e22a31)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:56.410515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:56.516326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67317f45255e4140ab8cc39329e22a31', 'request_id': 'req-4c33ea15-f951-4aad-b33d-b25bf453cae1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.532010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67317f45255e4140ab8cc39329e22a31', 'request_id': 'req-4c33ea15-f951-4aad-b33d-b25bf453cae1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.545207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67317f45255e4140ab8cc39329e22a31', 'request_id': 'req-4c33ea15-f951-4aad-b33d-b25bf453cae1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.564798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] The token cache is being invalidate because project 67317f45255e4140ab8cc39329e22a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:56.564798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.567091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.575979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f773a-cf1e-4a3c-9b54-c99b3487e2b9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.576520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f773a-cf1e-4a3c-9b54-c99b3487e2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.576712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f773a-cf1e-4a3c-9b54-c99b3487e2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.580378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 878/1746] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:56 2022] DELETE /identity/v3/projects/67317f45255e4140ab8cc39329e22a31 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:56.616686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:56.617935 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.629330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6a2f773a-cf1e-4a3c-9b54-c99b3487e2b9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:56.631985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6a2f773a-cf1e-4a3c-9b54-c99b3487e2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.711592 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33ea15-f951-4aad-b33d-b25bf453cae1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:56.716847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:56.717477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.717757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.719487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] PATH_INFO: `/v3/projects/fe9a1551e7fe473290b40048dd94b295` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.719487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9a1551e7fe473290b40048dd94b295)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:56.721433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:56.726257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 869/1747] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:56.735821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.736111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.736552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.744486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:56.749360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:56.760573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:56.761801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.772429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 870/1748] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:56.777034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:56.786068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4407e6d-ca47-4dba-bd62-0fbb387853b4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:56.786239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9a1551e7fe473290b40048dd94b295', 'request_id': 'req-b9585b27-81be-49d4-ae7c-81f67d83eee5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.798473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9a1551e7fe473290b40048dd94b295', 'request_id': 'req-b9585b27-81be-49d4-ae7c-81f67d83eee5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.805559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9a1551e7fe473290b40048dd94b295', 'request_id': 'req-b9585b27-81be-49d4-ae7c-81f67d83eee5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.823071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] The token cache is being invalidate because project fe9a1551e7fe473290b40048dd94b295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:56.823412 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.826012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:56.826301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 879/1749] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:56 2022] DELETE /identity/v3/projects/fe9a1551e7fe473290b40048dd94b295 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:56.830669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:56.832967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.887797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:56.888706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.889089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.889539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.890333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:56.890643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:56.893419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:56.915643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 871/1750] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:05:56.916696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:56.919529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:56.930468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9585b27-81be-49d4-ae7c-81f67d83eee5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:56.940161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82178b-6ddd-47ab-a733-dc15ac3f3ca7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:56.945914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:56.946682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.946963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.947237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] PATH_INFO: `/v3/users/620674c0fdf641dfa459456306e9e6f5` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.947859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:56.948503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:56.948780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:56.948955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] RBAC: Authorizing `identity:delete_user(user_id=620674c0fdf641dfa459456306e9e6f5)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:56.949195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:56.950142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:56.951691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:56.954473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:56.995872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 872/1751] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:56 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:57.000666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:57.023833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620674c0fdf641dfa459456306e9e6f5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:57.039955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620674c0fdf641dfa459456306e9e6f5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:57.040988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620674c0fdf641dfa459456306e9e6f5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:57.054453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620674c0fdf641dfa459456306e9e6f5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:57.070382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620674c0fdf641dfa459456306e9e6f5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:57.083769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 880/1752] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:56 2022] DELETE /identity/v3/users/620674c0fdf641dfa459456306e9e6f5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:57.122814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9932a8-277f-451f-9860-6fbd1013428d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:57.205534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:57.206261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.206541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.206867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.207622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:57.210066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:57.238878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 873/1753] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:56 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:57.243508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:57.246814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:57.266236 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0537-e4d4-4a52-85e3-5d472395062e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:57.272635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:57.275176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.275672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.276325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.277327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:57.279314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:57.301475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 881/1754] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:57.301606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:57.309874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:57.314394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8899-6f4a-49e1-a4a5-c8c0d503df28 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:57.350387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a79718-54e5-4648-aac9-7e941c8b3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:57.351559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79718-54e5-4648-aac9-7e941c8b3db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.351828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79718-54e5-4648-aac9-7e941c8b3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.352090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79718-54e5-4648-aac9-7e941c8b3db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.352768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a79718-54e5-4648-aac9-7e941c8b3db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:57.355180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a79718-54e5-4648-aac9-7e941c8b3db2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:57.371647 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:57.378067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 874/1755] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:05:57.384050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884d7b6-2671-423c-9e5c-ca4234410bd4 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:57.392989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:57.394083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.394819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.395404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] PATH_INFO: `/v3/projects/d5afa9a537bc4d3aadda19e3e992ef1e/users/c94486003989491ab09da96dbb4a0ea7/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.430141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:57.463825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5afa9a537bc4d3aadda19e3e992ef1e, user_id=c94486003989491ab09da96dbb4a0ea7, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:57.468691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:57.500117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 882/1756] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:57 2022] PUT /identity/v3/projects/d5afa9a537bc4d3aadda19e3e992ef1e/users/c94486003989491ab09da96dbb4a0ea7/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:05:57.504988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.505544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.506022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.534464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:57.535654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:57.616386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 875/1757] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:05:57.623769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:57.625624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:57.725472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1ca-5ad9-4832-8b68-d971055c0210 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:57.730641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b37ea6-6863-4836-84fb-905457844f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:57.731275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37ea6-6863-4836-84fb-905457844f9d service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.731556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37ea6-6863-4836-84fb-905457844f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.731832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37ea6-6863-4836-84fb-905457844f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.747912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37ea6-6863-4836-84fb-905457844f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:57.762899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37ea6-6863-4836-84fb-905457844f9d service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:57.781986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 883/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:57.849719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:57.852578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:57.872761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce507c-c5ef-48b2-b441-6ed4ff0fcdf3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:57.886134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:57.887386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:57.887687 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:57.887950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] PATH_INFO: `/v3/projects/c56964e3dfcc4418b88f527acae478c2` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:57.889188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56964e3dfcc4418b88f527acae478c2)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:57.891177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:57.983407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56964e3dfcc4418b88f527acae478c2', 'request_id': 'req-c30e7199-bad5-4a8c-8435-9a14139f2070'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:57.995359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56964e3dfcc4418b88f527acae478c2', 'request_id': 'req-c30e7199-bad5-4a8c-8435-9a14139f2070'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:58.003777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56964e3dfcc4418b88f527acae478c2', 'request_id': 'req-c30e7199-bad5-4a8c-8435-9a14139f2070'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:58.020911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] The token cache is being invalidate because project c56964e3dfcc4418b88f527acae478c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:05:58.021217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:58.021945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c30e7199-bad5-4a8c-8435-9a14139f2070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:58.024145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 876/1759] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:05:57 2022] DELETE /identity/v3/projects/c56964e3dfcc4418b88f527acae478c2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:58.029309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506563-9f30-4f00-ac33-529162067178 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.029889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506563-9f30-4f00-ac33-529162067178 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.030010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3506563-9f30-4f00-ac33-529162067178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.058562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-e3506563-9f30-4f00-ac33-529162067178 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:58.059971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e3506563-9f30-4f00-ac33-529162067178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:58.143164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 884/1760] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:58.151485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.151999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.152450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.191916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:58.193210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:58.204376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 877/1761] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:58.206316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506563-9f30-4f00-ac33-529162067178 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:58.217545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3506563-9f30-4f00-ac33-529162067178 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:58.223659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:58.224284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.224600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.224871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.225549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:05:58.226399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:58.228219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:58.242950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 885/1762] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:05:58.247297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:58.273196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872c48d-3672-417b-a266-e75c5f58fa5f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:58.287244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:58.287893 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.288150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.288567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.289285 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:58.293398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:58.360107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 878/1763] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:58 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:58.360787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:58.379830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4565be-46c4-4fcb-9f79-961b0f25454f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:58.483426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:58.484475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.484903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.485305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.486580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:58.489210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:58.520618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 886/1764] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:58 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:05:58.525585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:58.544653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7b1c3-822a-4f75-8582-819ce4124a6e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:58.555935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:58.556590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.556868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.557147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.557803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:58.559604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:58.589463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 879/1765] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:58.593944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:58.619685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc658-7802-44ad-bb17-12bb118d190f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:58.634154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a848a5-031b-4605-b014-72e017165173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:58.635113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a848a5-031b-4605-b014-72e017165173 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.635597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a848a5-031b-4605-b014-72e017165173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.636049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a848a5-031b-4605-b014-72e017165173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.637037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a848a5-031b-4605-b014-72e017165173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:58.640362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a848a5-031b-4605-b014-72e017165173 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:58.652564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:58.665669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:58.673246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 887/1766] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:58.677922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8892cec-1e27-4602-9ce9-e722914ea993 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:58.684614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:58.684614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.684614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.685148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] PATH_INFO: `/v3/projects/fd4bb085abf0401c849efee002f3d32e/users/c2dff0c4af634aa5883040f5968a2976/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.714932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4bb085abf0401c849efee002f3d32e, user_id=c2dff0c4af634aa5883040f5968a2976, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:58.719977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:58.755364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 880/1767] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:58 2022] PUT /identity/v3/projects/fd4bb085abf0401c849efee002f3d32e/users/c2dff0c4af634aa5883040f5968a2976/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:58.756262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:58.756630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:58.757033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:58.842315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] MFA Rules not processed for user `c2dff0c4af634aa5883040f5968a2976`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:58.843851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.042107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 888/1768] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:59.047119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.060591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.067877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.072870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:59.211640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f88cf-5212-4ac8-a94f-73c0085a7167 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.219091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a41a5-9a81-43c4-8235-04a60b41558d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.219513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.220183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.221251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.221483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] PATH_INFO: `/v3/users/573a2879a1684691831a7f1cb991de6b` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.223054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573a2879a1684691831a7f1cb991de6b)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.232182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.233237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.233594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.233948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.234917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.242055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.243141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.314917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 881/1769] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:59 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:59.317515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.356095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573a2879a1684691831a7f1cb991de6b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:59.436417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232c93-9a65-4596-b677-4dfbff0c59ed admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.438336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573a2879a1684691831a7f1cb991de6b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:59.439968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573a2879a1684691831a7f1cb991de6b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:59.443666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebf6e8-9318-4c59-994c-e3f304b98fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.444957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf6e8-9318-4c59-994c-e3f304b98fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.445348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf6e8-9318-4c59-994c-e3f304b98fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.445715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebf6e8-9318-4c59-994c-e3f304b98fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.447426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf6e8-9318-4c59-994c-e3f304b98fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.450135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebf6e8-9318-4c59-994c-e3f304b98fd6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.477249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573a2879a1684691831a7f1cb991de6b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:59.479879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 882/1770] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:59 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:59.481800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709713-d906-4c2d-90ef-f5951adcf042 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.482163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709713-d906-4c2d-90ef-f5951adcf042 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.482502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4709713-d906-4c2d-90ef-f5951adcf042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.495720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573a2879a1684691831a7f1cb991de6b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:05:59.503177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 889/1771] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:05:59 2022] DELETE /identity/v3/users/573a2879a1684691831a7f1cb991de6b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:59.503844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.505437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.528185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a4709713-d906-4c2d-90ef-f5951adcf042 None None] MFA Rules not processed for user `c94486003989491ab09da96dbb4a0ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:59.529770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a4709713-d906-4c2d-90ef-f5951adcf042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.536572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:59.627387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 883/1772] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:59.628631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.628914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.629195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.650009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24be77-7817-4819-b12d-0d32a74bb542 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.652556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:05:59.653772 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.655893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.656794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.657323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.657791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.658746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.661134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.662425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 884/1773] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:05:59.663265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.664609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.675730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 890/1774] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:05:59.677003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.678947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:05:59.683323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad58a2-32cd-46a6-8c8f-ceac1c247b71 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.691170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.691793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.692072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.692533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.693179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.695709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.711170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:59.745395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 885/1775] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:05:59 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:05:59.749553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.754742 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b00ab-54ee-4750-a11b-057715e65adb admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.821823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.822399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.822681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.823163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.834894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ee3e2-e8d9-4b7a-a7ef-f89b3f891e42 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.840559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:05:59.841478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:05:59.842282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:05:59.842636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] PATH_INFO: `/v3/projects/26cd230b95bb445390da5949812e2e9a/users/f350e37871394131b0b1bffdb45d15b5/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:05:59.879529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cd230b95bb445390da5949812e2e9a, user_id=f350e37871394131b0b1bffdb45d15b5, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.885621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.903895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 886/1776] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:05:59 2022] PUT /identity/v3/projects/26cd230b95bb445390da5949812e2e9a/users/f350e37871394131b0b1bffdb45d15b5/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:05:59.905692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.916210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:05:59.918036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:05:59.935326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 891/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:05:59.936471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:05:59.953664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557d6e3-289d-4756-b9b4-db8f6b4c5d1d service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:05:59.966112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:05:59.999649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc522b-2fcc-4106-9446-a002e7b0f643 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.011415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.012136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.012474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.012791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.014463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.016473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.030731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.031627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.032040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.033200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.034043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.035905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.056169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 892/1778] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:00.057887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.067291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 887/1779] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:05:59 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:00.071213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.080395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf6bd5-db8a-4ce6-b4b5-7555756d14e9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.082310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b11ed-ddb3-4ae7-812f-e619c58f805a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.087551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f48ab-da44-44be-a8e7-3657c12ef38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.088229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f48ab-da44-44be-a8e7-3657c12ef38e admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.088563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f48ab-da44-44be-a8e7-3657c12ef38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.088827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f48ab-da44-44be-a8e7-3657c12ef38e admin admin] PATH_INFO: `/v3/projects/26cd230b95bb445390da5949812e2e9a/users/f350e37871394131b0b1bffdb45d15b5/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.096530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.096737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f48ab-da44-44be-a8e7-3657c12ef38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cd230b95bb445390da5949812e2e9a, user_id=f350e37871394131b0b1bffdb45d15b5, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.096836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.096836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.096836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.096836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.097183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f48ab-da44-44be-a8e7-3657c12ef38e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.097267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.116720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 893/1780] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:00 2022] PUT /identity/v3/projects/26cd230b95bb445390da5949812e2e9a/users/f350e37871394131b0b1bffdb45d15b5/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:00.117185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 888/1781] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:00.123295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.124244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.124675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.124992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.144895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033de2-6555-4fd2-91fb-02052acc904e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.172760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] MFA Rules not processed for user `f350e37871394131b0b1bffdb45d15b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:00.175903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:00.248626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:00.281011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.281705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.281980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.282254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] PATH_INFO: `/v3/projects/577d7e2e2148410ab8b8a98282053b64/users/e058588749e744b5b3abd457aba29690/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.319231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=577d7e2e2148410ab8b8a98282053b64, user_id=e058588749e744b5b3abd457aba29690, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.325658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.378918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 889/1782] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:00 2022] PUT /identity/v3/projects/577d7e2e2148410ab8b8a98282053b64/users/e058588749e744b5b3abd457aba29690/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:00.379081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 894/1783] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:00.379162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.383880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:00.390846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.406427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe51069-1836-44bd-88d4-4af21e9bd3f3 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.524925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.526491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.527532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.528241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.530070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.532516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.545207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330f27-8d8c-40ba-9135-2a0bdd6dcbed admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.551862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.553420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.553772 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.554057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] PATH_INFO: `/v3/projects/4b0f9793aaf3414da5475520af5e85c7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.555723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0f9793aaf3414da5475520af5e85c7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.557692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.563192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 895/1784] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:00.563192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.564165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:00.616112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:00.663119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0f9793aaf3414da5475520af5e85c7', 'request_id': 'req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:00.687003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0f9793aaf3414da5475520af5e85c7', 'request_id': 'req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:00.701720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f73b-8b81-464d-a656-3a3389e1e9a7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.714902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0f9793aaf3414da5475520af5e85c7', 'request_id': 'req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:00.760738 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] The token cache is being invalidate because project 4b0f9793aaf3414da5475520af5e85c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:00.763014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:00.764214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:00.770936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 890/1785] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:00 2022] DELETE /identity/v3/projects/4b0f9793aaf3414da5475520af5e85c7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:00.771817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:00.776553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:00.879987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.880654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.881145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.881273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.885451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:00.911895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d419-5a6c-4787-8175-d1ccd3e4e85e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:00.932373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5b84c-23a4-45ea-9aed-f3da3b495cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:00.933274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5b84c-23a4-45ea-9aed-f3da3b495cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.933562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5b84c-23a4-45ea-9aed-f3da3b495cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.933838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5b84c-23a4-45ea-9aed-f3da3b495cca admin admin] PATH_INFO: `/v3/projects/577d7e2e2148410ab8b8a98282053b64/users/e058588749e744b5b3abd457aba29690/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:00.939288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5b84c-23a4-45ea-9aed-f3da3b495cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=577d7e2e2148410ab8b8a98282053b64, user_id=e058588749e744b5b3abd457aba29690, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:00.942930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5b84c-23a4-45ea-9aed-f3da3b495cca admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:00.950239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:00.957783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 891/1786] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:00 2022] PUT /identity/v3/projects/577d7e2e2148410ab8b8a98282053b64/users/e058588749e744b5b3abd457aba29690/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:00.959193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:00.959532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:00.959812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.000882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:01.003011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.045716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.049152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f8d7a-038f-4e45-bef4-11048f37bb96 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.072102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 896/1787] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:01.088590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 892/1788] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:01.097334 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76828-d899-4114-b67a-7f39e069808f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.097629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76828-d899-4114-b67a-7f39e069808f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.097933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76828-d899-4114-b67a-7f39e069808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.154664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-86b76828-d899-4114-b67a-7f39e069808f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:01.157291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-86b76828-d899-4114-b67a-7f39e069808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.178497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 897/1789] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:01.182279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.198254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe27ef-4336-464a-b473-789efe81ec36 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.203700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.204833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.204833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.205453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.206221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:01.206692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.209033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.232367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 893/1790] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:01.234132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76828-d899-4114-b67a-7f39e069808f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.251835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76828-d899-4114-b67a-7f39e069808f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.262893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.263535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.264270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.264825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.265649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.268893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.310963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.315881 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.344011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151fbd-40c8-4314-84a8-f761fdbe0598 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.351654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.352489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.352766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.353084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] PATH_INFO: `/v3/users/c2dff0c4af634aa5883040f5968a2976` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.354650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2dff0c4af634aa5883040f5968a2976)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.356808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.363185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 898/1791] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:01 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:01.364216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.423083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2dff0c4af634aa5883040f5968a2976'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:01.432846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:01.439426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2dff0c4af634aa5883040f5968a2976'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:01.441044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2dff0c4af634aa5883040f5968a2976'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:01.447522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721670f-0f70-4743-86ce-28b2aedaa04c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.450326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2dff0c4af634aa5883040f5968a2976'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:01.453816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.454440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.454790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.455104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.455904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.457991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.464496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3ff51437-1427-4539-97c0-b8e8a08a29e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2dff0c4af634aa5883040f5968a2976'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:01.475439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 894/1792] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:01 2022] DELETE /identity/v3/users/c2dff0c4af634aa5883040f5968a2976 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:01.481387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300386-5e39-42c6-b63d-71b6792a93ab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.481839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300386-5e39-42c6-b63d-71b6792a93ab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.482210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300386-5e39-42c6-b63d-71b6792a93ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.487812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 899/1793] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:01 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:01.492071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.495016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.509791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e4300386-5e39-42c6-b63d-71b6792a93ab None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:01.511346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e4300386-5e39-42c6-b63d-71b6792a93ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.512101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96a23-f95a-4175-9411-fd22f768fe80 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.589832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.590930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.592030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.592552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.593449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.596090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.604771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:01.607963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 900/1794] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:01.612139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.621444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 895/1795] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:01.631681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e05b-fdc5-4ec6-a1d3-e0f595e0b2e2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.636457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87899e6-9756-49da-995c-1992f059d4a6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.636871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87899e6-9756-49da-995c-1992f059d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.637376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87899e6-9756-49da-995c-1992f059d4a6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.638847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 896/1796] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:06:01.640835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.641481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.641784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.642059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.642723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.647528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.660619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.660619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.660619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.676477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:01.677936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.678148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 901/1797] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:01.682629 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.699131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499140e-2086-440d-a5e0-135bc2ce9487 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.714097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.715853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.716420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.717239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] PATH_INFO: `/v3/projects/1abf76394f664fcf89003dbb38e52777/users/0107a86ca5864b4db5c874bc03c0b26a/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.756107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abf76394f664fcf89003dbb38e52777, user_id=0107a86ca5864b4db5c874bc03c0b26a, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.759853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:01.783739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 902/1798] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:01 2022] PUT /identity/v3/projects/1abf76394f664fcf89003dbb38e52777/users/0107a86ca5864b4db5c874bc03c0b26a/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:01.785284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.793820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.815443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 897/1799] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:06:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:01.817375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:01.846319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:01.864081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e5ff-63d0-465c-a4eb-12896bb490d3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.879127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4d57f-b9cc-4c5f-b521-1d7e6d041475 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:01.884977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020c26-c457-4ca8-bd12-ec512b296624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.885880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020c26-c457-4ca8-bd12-ec512b296624 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.886096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020c26-c457-4ca8-bd12-ec512b296624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.886396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020c26-c457-4ca8-bd12-ec512b296624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.950533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:01.951548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:01.951949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:01.952704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] PATH_INFO: `/v3/users/d26cf2fdfb9e4eaaae2467fa760343a7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:01.953804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26cf2fdfb9e4eaaae2467fa760343a7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:01.955957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:02.008314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:02.014885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00020c26-c457-4ca8-bd12-ec512b296624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:02.016557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00020c26-c457-4ca8-bd12-ec512b296624 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:02.029213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26cf2fdfb9e4eaaae2467fa760343a7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.030281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 903/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:02.031287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf482-417a-4372-ac01-00009314781d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.032179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf482-417a-4372-ac01-00009314781d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.032301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf482-417a-4372-ac01-00009314781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.058651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26cf2fdfb9e4eaaae2467fa760343a7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.059413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26cf2fdfb9e4eaaae2467fa760343a7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.069448 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26cf2fdfb9e4eaaae2467fa760343a7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.074302 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c06cf482-417a-4372-ac01-00009314781d None None] MFA Rules not processed for user `0107a86ca5864b4db5c874bc03c0b26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:02.075612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c06cf482-417a-4372-ac01-00009314781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.081484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26cf2fdfb9e4eaaae2467fa760343a7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.092397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 898/1801] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:01 2022] DELETE /identity/v3/users/d26cf2fdfb9e4eaaae2467fa760343a7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:02.094059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:02.095684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.124366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:02.183044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 904/1802] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:02.198219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf482-417a-4372-ac01-00009314781d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:02.200092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c06cf482-417a-4372-ac01-00009314781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.221725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbd703-70bb-4c70-8c2b-10d3a82d0f2e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:02.228985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:02.229967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.230355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.230722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.233073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.257643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:02.262553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60b712-1539-48d3-bbdf-acea1ea3d767 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:02.280372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 899/1803] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:02.285957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.286339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.286615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.334247 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] MFA Rules not processed for user `e058588749e744b5b3abd457aba29690`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:02.335872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.380546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf482-417a-4372-ac01-00009314781d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:02.454779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfbcec-4909-41ed-9b94-895c5890c2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:02.455735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfbcec-4909-41ed-9b94-895c5890c2db service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.456174 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfbcec-4909-41ed-9b94-895c5890c2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.456598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfbcec-4909-41ed-9b94-895c5890c2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.493440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 900/1804] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:02.494583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:02.503523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.568141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfbcec-4909-41ed-9b94-895c5890c2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:02.571022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfbcec-4909-41ed-9b94-895c5890c2db service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:02.575215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:02.583431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 905/1805] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:02.585037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.585461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.585807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.643566 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] MFA Rules not processed for user `c94486003989491ab09da96dbb4a0ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:02.646005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.688997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d4e94-a18c-4f9b-ae47-788201e2ffb0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:02.715599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:02.716453 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.716741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.718804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] PATH_INFO: `/v3/projects/268597ccb0ed443d99018d285742a04e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.720633 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=268597ccb0ed443d99018d285742a04e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:02.722196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:02.746516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 906/1806] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:02.756089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:02.758251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:02.825705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:02.856704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268597ccb0ed443d99018d285742a04e', 'request_id': 'req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.873368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268597ccb0ed443d99018d285742a04e', 'request_id': 'req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.888912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268597ccb0ed443d99018d285742a04e', 'request_id': 'req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.910481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b552-fb03-4007-a6ec-5d5570a1026d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:02.932878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] The token cache is being invalidate because project 268597ccb0ed443d99018d285742a04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:02.933224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.933916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a64eeebd-f8e4-4f6f-b745-8d7ab370f244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:02.938970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 901/1807] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:02 2022] DELETE /identity/v3/projects/268597ccb0ed443d99018d285742a04e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:02.944982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:02.945462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:02.945888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:02.995948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:02.998389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.057823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.058530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.058810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.059125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.067128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.108051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 902/1808] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:03.109630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.111289 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.119268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:03.137233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a56b6-8d45-4710-bd10-d6d19251644a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.153444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.154302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.154586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.154861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] PATH_INFO: `/v3/projects/fd4bb085abf0401c849efee002f3d32e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.157168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4bb085abf0401c849efee002f3d32e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.159858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.192841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.194716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c35ac3-5add-47f3-a7c5-8c14642a2230 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.220582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 907/1809] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:06:03.223026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.223500 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.224023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.258555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:03.260000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.278771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4bb085abf0401c849efee002f3d32e', 'request_id': 'req-b41762b5-514a-45fb-ab64-f933443d2bc9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.293447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4bb085abf0401c849efee002f3d32e', 'request_id': 'req-b41762b5-514a-45fb-ab64-f933443d2bc9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.312706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4bb085abf0401c849efee002f3d32e', 'request_id': 'req-b41762b5-514a-45fb-ab64-f933443d2bc9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.329078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] The token cache is being invalidate because project fd4bb085abf0401c849efee002f3d32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:03.329416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.330865 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.337107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 903/1810] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:03 2022] DELETE /identity/v3/projects/fd4bb085abf0401c849efee002f3d32e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:03.338029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.340229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.412376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:03.414737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 908/1811] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:03.419879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.430517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41fb8b-f2e1-4384-938a-45c9adda04e6 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.435968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.436843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.437336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.437768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.438626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:03.439098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.441545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.457212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41762b5-514a-45fb-ab64-f933443d2bc9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.457976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 909/1812] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:03.462878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.471188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.472221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.474361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.475000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] PATH_INFO: `/v3/users/f350e37871394131b0b1bffdb45d15b5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.478257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1c6d-f145-4ccf-803e-3ba88210aa7e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.481076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f350e37871394131b0b1bffdb45d15b5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.483443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.484122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.484504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.484963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.485723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.488133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.488896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.538579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 910/1813] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:03 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:03.543346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.577781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f350e37871394131b0b1bffdb45d15b5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.612814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f350e37871394131b0b1bffdb45d15b5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.614070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f350e37871394131b0b1bffdb45d15b5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.623750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f350e37871394131b0b1bffdb45d15b5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.628477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9aa16-667d-4fd9-9c90-73929bf52883 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.635214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.635392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f350e37871394131b0b1bffdb45d15b5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:03.635830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.636108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.636402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.637036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.638970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.643158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 904/1814] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:03 2022] DELETE /identity/v3/users/f350e37871394131b0b1bffdb45d15b5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:03.673176 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 911/1815] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:03 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:03.677406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.678881 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.776943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4cd5-b523-4344-af33-f079cd8d45e4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.782450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.783135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.783489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.783836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.784722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.786721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.798187 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 905/1816] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:03.803445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.820977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf86a1b-6d9d-408c-9329-f19d757195f9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.826763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc45c6-c3b1-4f26-a9c4-ed80596e47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.827501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc45c6-c3b1-4f26-a9c4-ed80596e47a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.828027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc45c6-c3b1-4f26-a9c4-ed80596e47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.828395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc45c6-c3b1-4f26-a9c4-ed80596e47a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.829217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc45c6-c3b1-4f26-a9c4-ed80596e47a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.831419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc45c6-c3b1-4f26-a9c4-ed80596e47a4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.844292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 912/1817] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:03.848372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.862748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f54e-1c31-488c-95db-82692eb5d2c9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:03.869785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:03.870535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.870879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.871344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] PATH_INFO: `/v3/projects/4a99608a9fcc4c25bc9c6b04eb3bdadc/users/b201d89f776641268684a61b680e2a4e/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.892635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a99608a9fcc4c25bc9c6b04eb3bdadc, user_id=b201d89f776641268684a61b680e2a4e, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:03.895815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:03.917982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 906/1818] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:03 2022] PUT /identity/v3/projects/4a99608a9fcc4c25bc9c6b04eb3bdadc/users/b201d89f776641268684a61b680e2a4e/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:03.927337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:03.927662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:03.927946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:03.974422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] MFA Rules not processed for user `b201d89f776641268684a61b680e2a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:03.976471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.980947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:03.983712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:03.988010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:04.030519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:04.069975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcfa96-c6cd-46df-997f-9b00d9ec6330 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.078561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.079804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.081452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.081742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] PATH_INFO: `/v3/projects/26cd230b95bb445390da5949812e2e9a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.086159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cd230b95bb445390da5949812e2e9a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.088373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.117535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 913/1819] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:04.121631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.133338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ebf08-7576-43da-a649-ace03942ac57 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.138558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.139319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.139651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.139987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.140847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.142754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.164976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cd230b95bb445390da5949812e2e9a', 'request_id': 'req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:04.172791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cd230b95bb445390da5949812e2e9a', 'request_id': 'req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:04.177152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 914/1820] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:04.184217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cd230b95bb445390da5949812e2e9a', 'request_id': 'req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:04.184692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.200142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] The token cache is being invalidate because project 26cd230b95bb445390da5949812e2e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:04.200615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:04.201723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38e93d94-3d0b-41aa-aa94-96f1c6160c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:04.203622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 907/1821] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:03 2022] DELETE /identity/v3/projects/26cd230b95bb445390da5949812e2e9a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:04.215879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d388754-ef60-4e9f-bf1d-d209920e8095 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.215879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d388754-ef60-4e9f-bf1d-d209920e8095 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.215879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d388754-ef60-4e9f-bf1d-d209920e8095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.236935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4d388754-ef60-4e9f-bf1d-d209920e8095 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:04.238379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4d388754-ef60-4e9f-bf1d-d209920e8095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:04.276288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3104-6001-49cd-8248-426aa4969412 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.285019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.286812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.287160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.287443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.288884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.293544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.316408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 908/1822] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:04.327925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.328211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.328516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.334497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 915/1823] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:04.351032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.352942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:04.365718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:04.367619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83173ec-a130-43a6-a520-16eccb05a738 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.368385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:04.373977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.374663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.375006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.375345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.376131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.377945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.396808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 916/1824] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:04.397174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 909/1825] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:04.401202 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.403917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.413709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093200d4-f689-46ab-98e3-776f9cafeebe None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.414077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea68351-5d76-4a0b-83d9-6e807ba4e095 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.420549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.420679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.421161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.421320 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.421459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.421609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.421728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.421883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] PATH_INFO: `/v3/projects/c67afd7333fb4d0dae07376f9acc5520/users/6f91d5207d774a87b645dc346b4ed512/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.422503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:04.422880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.425031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.442108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 910/1826] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:06:04.447162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67afd7333fb4d0dae07376f9acc5520, user_id=6f91d5207d774a87b645dc346b4ed512, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.449338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.450163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.462659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a6050-13ff-4238-8ffd-3db50857f336 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.473020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 917/1827] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:04 2022] PUT /identity/v3/projects/c67afd7333fb4d0dae07376f9acc5520/users/6f91d5207d774a87b645dc346b4ed512/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:04.477179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.518210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:04.542451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:04.547329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.548134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.548474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.548890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.549551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.553101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.572050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f88ac9-b7c1-4f01-9a16-0e18aa6d5ad5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.577296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.577985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.578265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.578542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.579286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.580869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.596162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 918/1828] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:04.605149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.613765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 911/1829] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:04.615330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.617310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285c6a-4436-46fe-9af0-66f8946008e6 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.700397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6091789-1f06-42b8-8f28-b398da105430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.701082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6091789-1f06-42b8-8f28-b398da105430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.701559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6091789-1f06-42b8-8f28-b398da105430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.701688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3715d7a-3368-4d0a-93cf-049c9eaf1a79 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.701800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6091789-1f06-42b8-8f28-b398da105430 admin admin] PATH_INFO: `/v3/projects/c67afd7333fb4d0dae07376f9acc5520/users/6f91d5207d774a87b645dc346b4ed512/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.703761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6091789-1f06-42b8-8f28-b398da105430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67afd7333fb4d0dae07376f9acc5520, user_id=6f91d5207d774a87b645dc346b4ed512, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.706698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6091789-1f06-42b8-8f28-b398da105430 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.717639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.718445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.719028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.719437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.720203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.722582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.732046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 919/1830] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:04 2022] PUT /identity/v3/projects/c67afd7333fb4d0dae07376f9acc5520/users/6f91d5207d774a87b645dc346b4ed512/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:04.733737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.734031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.734303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.756192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 912/1831] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:04.761020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.777424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] MFA Rules not processed for user `6f91d5207d774a87b645dc346b4ed512`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:04.778798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:04.784026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5802248-2bba-4382-bd46-d0856753ef88 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.875171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 920/1832] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:04.881945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.882473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.882473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.883010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.883294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.885108 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.893282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.899003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:04.899243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 913/1833] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:04.902977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:04.921841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd21c08-95b7-4958-8869-8fc3713d2765 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:04.929293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:04.930154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:04.930625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:04.930901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:04.931681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:04.934159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:04.961969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 914/1834] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:04.968891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.002757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23928-5bd5-4951-bfd4-b2e37996ada1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.018435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e5fb-2bff-414a-b810-2db7b78f1ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.019018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e5fb-2bff-414a-b810-2db7b78f1ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.019297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e5fb-2bff-414a-b810-2db7b78f1ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.019568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e5fb-2bff-414a-b810-2db7b78f1ea9 admin admin] PATH_INFO: `/v3/projects/d45f604fa127452684db22eee3e05e53/users/8ea81c7aec6448fb93aba6c4194eeca4/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.058397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e5fb-2bff-414a-b810-2db7b78f1ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45f604fa127452684db22eee3e05e53, user_id=8ea81c7aec6448fb93aba6c4194eeca4, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.061865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba8795-71c2-4b9b-a6ea-d46445a10774 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.062000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e5fb-2bff-414a-b810-2db7b78f1ea9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.070022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.070776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.071059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.071368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.091980 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 915/1835] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:04 2022] PUT /identity/v3/projects/d45f604fa127452684db22eee3e05e53/users/8ea81c7aec6448fb93aba6c4194eeca4/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:05.101699 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.101985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.102392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.112393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.112393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.122451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:05.135673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 921/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:05.210696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] MFA Rules not processed for user `8ea81c7aec6448fb93aba6c4194eeca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:05.215583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:05.243901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:05.294598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.299329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:05.327057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06630b82-adbe-4e1f-bfa2-45001a31891d service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.358694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 916/1837] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:05.363825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.472826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.473875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.474368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.474948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.478291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:05.517096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407030-44fb-4b3b-81fb-13739293d76e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.523619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.524681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.525164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.525588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.526585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.528962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.582058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 917/1838] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:05 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:05.582058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.591117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.598848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.625771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 922/1839] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:05.706111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4ba6-480d-47e0-bde5-a0877d3fd4e5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.721151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.721858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.722581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.723323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.723717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.726938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.728734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.730587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:05.759585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 918/1840] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:05 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:05.761542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.762506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acf3d-8826-44d2-a640-0c8ca63bf79b service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.775671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f0aa2-b7e8-4488-8662-1ad9c5c109a9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.777166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.777831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.778107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.778381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] PATH_INFO: `/v3/users/0107a86ca5864b4db5c874bc03c0b26a` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.779676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0107a86ca5864b4db5c874bc03c0b26a)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.784774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.785597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.785871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.786290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.787017 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.789732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.800666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.823873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 919/1841] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:05.829539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.849208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad2f29-b9f3-4a20-9ab7-2b3ee4c51761 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:05.865841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:05.872908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.872908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.872908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] PATH_INFO: `/v3/projects/d8032e00dc2b4e95a47a84a98b097345/users/dbd339d790a646f5a5beb36725fa1946/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.888484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:05.889343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0107a86ca5864b4db5c874bc03c0b26a'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:05.896847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8032e00dc2b4e95a47a84a98b097345, user_id=dbd339d790a646f5a5beb36725fa1946, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:05.900874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:05.911359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0107a86ca5864b4db5c874bc03c0b26a'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:05.912352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0107a86ca5864b4db5c874bc03c0b26a'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:05.922480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 920/1842] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:05 2022] PUT /identity/v3/projects/d8032e00dc2b4e95a47a84a98b097345/users/dbd339d790a646f5a5beb36725fa1946/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:05.922640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0107a86ca5864b4db5c874bc03c0b26a'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:05.924385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:05.929810 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-54728dbf-ae4a-4e38-b6dc-52b807310f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0107a86ca5864b4db5c874bc03c0b26a'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:05.940761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 923/1843] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:05 2022] DELETE /identity/v3/users/0107a86ca5864b4db5c874bc03c0b26a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:05.942556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:05.942903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:05.943473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:05.965157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:05.966575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:05.994804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:06.000821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903feec6-0075-40f0-8647-c712590b4218 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:06.045118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 924/1844] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:06.056111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:06.058122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:06.069113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:06.070273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.070549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.070829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.071527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:06.073237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:06.086110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 921/1845] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:06.090186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:06.092008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:06.106913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd78bdf-34ab-4727-ab62-91ac922fac72 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:06.114244 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90707f-c5be-4b74-b20c-1f0feb35f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:06.114998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90707f-c5be-4b74-b20c-1f0feb35f03e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.115347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90707f-c5be-4b74-b20c-1f0feb35f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.115691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90707f-c5be-4b74-b20c-1f0feb35f03e admin admin] PATH_INFO: `/v3/projects/d8032e00dc2b4e95a47a84a98b097345/users/dbd339d790a646f5a5beb36725fa1946/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.118252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90707f-c5be-4b74-b20c-1f0feb35f03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8032e00dc2b4e95a47a84a98b097345, user_id=dbd339d790a646f5a5beb36725fa1946, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:06.121234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90707f-c5be-4b74-b20c-1f0feb35f03e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:06.133131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 922/1846] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:06 2022] PUT /identity/v3/projects/d8032e00dc2b4e95a47a84a98b097345/users/dbd339d790a646f5a5beb36725fa1946/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:06.143256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.143538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.143807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.147621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88688d-270e-4c68-9288-f0cd75c161ee None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:06.175324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] MFA Rules not processed for user `dbd339d790a646f5a5beb36725fa1946`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:06.176895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:06.210235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:06.211011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.211367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.211709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.300890 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:06.302306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:06.314216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 925/1847] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:06.351377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 923/1848] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:06.359903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:06.361342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:06.407319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:06.435453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c6cdd-6e71-4dd4-9e32-7a91a895c187 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:06.439734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:06.440457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.440844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.441120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.451837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:06.453414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:06.464232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 926/1849] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:06.596553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:06.605232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:06.610897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda642-b14a-4482-b786-bcf6866fcc1e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:06.625143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:06.625776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.627558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.627843 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.630335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:06.745461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:06.746919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64c9fe-e6d3-48fa-83b7-1d47ea90e640 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:06.762365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 924/1850] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:06.890755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:06.892414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:06.922075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c84c-e3b0-4b11-a700-290b68a03068 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:06.928846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:06.929749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:06.932206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:06.932206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] PATH_INFO: `/v3/projects/1abf76394f664fcf89003dbb38e52777` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:06.933049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abf76394f664fcf89003dbb38e52777)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:06.935240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.016910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abf76394f664fcf89003dbb38e52777', 'request_id': 'req-4d8858fc-1d35-4706-8601-d2e3366750ec'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.031804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abf76394f664fcf89003dbb38e52777', 'request_id': 'req-4d8858fc-1d35-4706-8601-d2e3366750ec'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.043833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abf76394f664fcf89003dbb38e52777', 'request_id': 'req-4d8858fc-1d35-4706-8601-d2e3366750ec'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.059159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] The token cache is being invalidate because project 1abf76394f664fcf89003dbb38e52777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:07.059454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.060393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-4d8858fc-1d35-4706-8601-d2e3366750ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.062560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 927/1851] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:06 2022] DELETE /identity/v3/projects/1abf76394f664fcf89003dbb38e52777 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:07.067164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.067650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.067743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.093682 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:07.093682 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.180654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 925/1852] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:07.190770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.191270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.191378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.191785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.193824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.214076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:07.215544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.228854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5e31-b266-4fc1-a094-b3c5a35b233a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.229088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 928/1853] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:07.232497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.238332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.238991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.239304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.239640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] PATH_INFO: `/v3/users/8ea81c7aec6448fb93aba6c4194eeca4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.246737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea81c7aec6448fb93aba6c4194eeca4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.248831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.256396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35054ac-8b48-42f7-9f02-fbe2f5e253a1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.264021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.264986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.265467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.265937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.266929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:07.267450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.269316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.285613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 929/1854] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:06:07.291225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.303958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6565f-e91d-4267-b426-e017cb652f7d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.309877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.310693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.312968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.313634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.314792 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.318140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.362140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea81c7aec6448fb93aba6c4194eeca4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.398318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea81c7aec6448fb93aba6c4194eeca4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.399752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea81c7aec6448fb93aba6c4194eeca4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.401997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 930/1855] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:07.403969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.422355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea81c7aec6448fb93aba6c4194eeca4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.464472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fe7cfd4f-ad4c-4117-9fbe-ad23cc7d59a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea81c7aec6448fb93aba6c4194eeca4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:07.488815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 926/1856] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:07 2022] DELETE /identity/v3/users/8ea81c7aec6448fb93aba6c4194eeca4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:07.493050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c042cb-a3c2-464c-819e-47e5f1867766 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.493900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c042cb-a3c2-464c-819e-47e5f1867766 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.494178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c042cb-a3c2-464c-819e-47e5f1867766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.542359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b6c042cb-a3c2-464c-819e-47e5f1867766 None None] MFA Rules not processed for user `6f217d8aa8fc4e9292195f8ad624eca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:07.543746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b6c042cb-a3c2-464c-819e-47e5f1867766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.556110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:07.565616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a3e01-f95c-4715-8847-19e3a57ab5b5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.593146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:07.628468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 927/1857] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:07.628468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.628468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.628468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.645249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.645961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.646316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.646663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.647557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.650309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.650464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:07.651895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.660141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 928/1858] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:07.679692 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 931/1859] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:07.681258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.681381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.682878 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.683184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.696469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a956-d36c-4f8a-be13-d06f74f06547 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.703469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.704264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.704643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.705015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.705743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.707587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.722200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 932/1860] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:07.723607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.737787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a55b4-dff4-40dc-a339-e2bf28cb8876 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.744637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.745345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.745656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.745999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.746735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.748681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.763400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 933/1861] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:07.768557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:07.775402 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99db2c4-e2d8-4225-8173-7652297a55fe None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.785271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0279299-34ae-4b03-a659-50bc3f6d85a5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:07.786489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b399f-ce09-4488-8252-ccbe758d5f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.787111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b399f-ce09-4488-8252-ccbe758d5f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.787392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b399f-ce09-4488-8252-ccbe758d5f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.787666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b399f-ce09-4488-8252-ccbe758d5f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.796972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:07.797710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.798096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.798374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] PATH_INFO: `/v3/projects/565ae53c7aee4c469d7b45f692747fab/users/96838394906d4020b1e692d3afa8cea0/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.805148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b399f-ce09-4488-8252-ccbe758d5f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.808400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b399f-ce09-4488-8252-ccbe758d5f87 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.818795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] RBAC: Authorizing `identity:create_grant(project_id=565ae53c7aee4c469d7b45f692747fab, user_id=96838394906d4020b1e692d3afa8cea0, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:07.823104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:07.826577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 929/1862] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:07.840128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 934/1863] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:07 2022] PUT /identity/v3/projects/565ae53c7aee4c469d7b45f692747fab/users/96838394906d4020b1e692d3afa8cea0/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:07.852143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:07.852461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:07.852717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:07.901895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] MFA Rules not processed for user `96838394906d4020b1e692d3afa8cea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:07.903313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:07.987236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 930/1864] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:08.000078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:08.002307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:08.072233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa324b44-74e4-4650-9e8f-d2743331710e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:08.076872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:08.077615 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:08.077752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:08.077953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:08.088572 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:08.096309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:08.106048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 935/1865] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:08.583394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:08.585547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:08.714809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:08.738705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48ddc6-9cf5-406b-8039-e3c68ca7f056 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:08.744712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:08.745534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:08.746088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:08.746513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] PATH_INFO: `/v3/projects/d45f604fa127452684db22eee3e05e53` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:08.748030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45f604fa127452684db22eee3e05e53)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:08.750163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:08.870696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45f604fa127452684db22eee3e05e53', 'request_id': 'req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:08.885890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45f604fa127452684db22eee3e05e53', 'request_id': 'req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:08.894565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45f604fa127452684db22eee3e05e53', 'request_id': 'req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:08.911675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] The token cache is being invalidate because project d45f604fa127452684db22eee3e05e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:08.912229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:08.913499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:08.916798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 931/1866] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:08 2022] DELETE /identity/v3/projects/d45f604fa127452684db22eee3e05e53 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:08.921264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:08.941718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa4495-3cb1-4022-8659-20a954ee4dd0 service glance] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:09.019130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:09.019719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:09.020002 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:09.020311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] PATH_INFO: `/v3/users/dbd339d790a646f5a5beb36725fa1946` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:09.021502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd339d790a646f5a5beb36725fa1946)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:09.024092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:09.036383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:09.086403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd339d790a646f5a5beb36725fa1946'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.099660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd339d790a646f5a5beb36725fa1946'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.100456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd339d790a646f5a5beb36725fa1946'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.107322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd339d790a646f5a5beb36725fa1946'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.114935 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3eac3739-b2cd-4287-9be1-513815f22987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd339d790a646f5a5beb36725fa1946'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.121348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 936/1867] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:08 2022] DELETE /identity/v3/users/dbd339d790a646f5a5beb36725fa1946 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:09.488593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:09.490111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:09.510498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52fb8-5093-4f32-a7b6-d8e4b80796f9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:09.589441 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:09.590160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:09.590443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:09.590816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] PATH_INFO: `/v3/projects/d8032e00dc2b4e95a47a84a98b097345` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:09.592799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8032e00dc2b4e95a47a84a98b097345)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:09.595752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:09.685770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8032e00dc2b4e95a47a84a98b097345', 'request_id': 'req-adfbf236-d7fc-4188-907c-3c4c47536574'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.697075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8032e00dc2b4e95a47a84a98b097345', 'request_id': 'req-adfbf236-d7fc-4188-907c-3c4c47536574'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.708928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8032e00dc2b4e95a47a84a98b097345', 'request_id': 'req-adfbf236-d7fc-4188-907c-3c4c47536574'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.727925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] The token cache is being invalidate because project d8032e00dc2b4e95a47a84a98b097345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:09.728225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.729096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-adfbf236-d7fc-4188-907c-3c4c47536574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:09.731538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 932/1868] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:09 2022] DELETE /identity/v3/projects/d8032e00dc2b4e95a47a84a98b097345 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:09.739963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:09.740277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:09.740645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:09.760623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:09.761849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:09.831438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 937/1869] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:09.839637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:09.840007 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:09.840380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:09.855844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:09.864178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:09.865743 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:09.877692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 933/1870] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:09.881891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:09.893288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87123e-531a-40d0-a000-9043929fb264 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:09.898663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:09.899269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:09.899546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:09.899820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:09.900520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:09.900850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:09.902518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:09.915078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 938/1871] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:09.919790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:09.936064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0228-7405-49ef-b256-31d7f3b6a3f8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:09.948077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:09.948746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:09.949028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:09.949307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:09.949954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:09.951892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:09.987377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 934/1872] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:09 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:09.991210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:10.008191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234853b1-ea4a-44b9-bd08-7d4110e6fda9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:10.072698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:10.073989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:10.073989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:10.073989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:10.074824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:10.076836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:10.102690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 939/1873] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:09 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:10.107255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:10.118526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46ff15-3a54-44a5-a72f-b78d8174c32b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:10.123764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:10.124459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:10.124737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:10.125010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:10.125646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:10.127350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:10.138067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 935/1874] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:10.142777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:10.152399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:10.158933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f2240-8509-41e3-ba2f-4bb71780f488 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:10.167797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991187f-1572-4755-9054-2da30d771e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:10.168558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991187f-1572-4755-9054-2da30d771e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:10.168898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991187f-1572-4755-9054-2da30d771e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:10.169173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991187f-1572-4755-9054-2da30d771e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:10.169827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991187f-1572-4755-9054-2da30d771e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:10.171383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991187f-1572-4755-9054-2da30d771e64 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:10.182972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 940/1875] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:10.187416 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:10.199502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fb7af-40fb-4597-a287-567e6a2592d4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:10.204282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:10.205086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:10.205451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:10.205703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] PATH_INFO: `/v3/projects/58ae406e119d4d1a886598feb337473e/users/ad333b340f8c449f80083e273b382c83/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:10.228976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ae406e119d4d1a886598feb337473e, user_id=ad333b340f8c449f80083e273b382c83, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:10.232067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:10.255833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 936/1876] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:10 2022] PUT /identity/v3/projects/58ae406e119d4d1a886598feb337473e/users/ad333b340f8c449f80083e273b382c83/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:10.267327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:10.268071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:10.268822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:10.333260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] MFA Rules not processed for user `ad333b340f8c449f80083e273b382c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:10.334888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:10.448386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 941/1877] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:10.464216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:10.466256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:10.564852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943cce-a903-45e4-9ea2-d5e9f642c0dc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:10.569421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca87c8-fe18-4442-810c-e6b4c5899691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:10.570163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca87c8-fe18-4442-810c-e6b4c5899691 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:10.570519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca87c8-fe18-4442-810c-e6b4c5899691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:10.570848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca87c8-fe18-4442-810c-e6b4c5899691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:10.582380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca87c8-fe18-4442-810c-e6b4c5899691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:10.583958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca87c8-fe18-4442-810c-e6b4c5899691 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:10.595415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 937/1878] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:11.085903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:11.087554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:11.175730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665246-c58b-4d18-b470-ea2801b44920 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:11.181673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:11.182748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:11.183217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:11.183923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] PATH_INFO: `/v3/users/90f11f0d98aa4ec0bd966fdb8c3a5442` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:11.185329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f11f0d98aa4ec0bd966fdb8c3a5442)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:11.189440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:11.254460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f11f0d98aa4ec0bd966fdb8c3a5442'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.281252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f11f0d98aa4ec0bd966fdb8c3a5442'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.282927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f11f0d98aa4ec0bd966fdb8c3a5442'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.293281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f11f0d98aa4ec0bd966fdb8c3a5442'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.302390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f11f0d98aa4ec0bd966fdb8c3a5442'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.310805 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 942/1879] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:11 2022] DELETE /identity/v3/users/90f11f0d98aa4ec0bd966fdb8c3a5442 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:11.315758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343753-3975-4c87-8942-add37aff0eba None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:11.316217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343753-3975-4c87-8942-add37aff0eba None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:11.316662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41343753-3975-4c87-8942-add37aff0eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:11.339518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-41343753-3975-4c87-8942-add37aff0eba None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:11.340872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-41343753-3975-4c87-8942-add37aff0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:11.424101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 938/1880] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:11.433597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:11.435169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:11.440774 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:11.501016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7adf6-31ee-4253-a8e4-4790d51855a2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:11.504700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa03459-95f9-477b-8f65-26d299294059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:11.505233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa03459-95f9-477b-8f65-26d299294059 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:11.505507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa03459-95f9-477b-8f65-26d299294059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:11.505772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa03459-95f9-477b-8f65-26d299294059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:11.514719 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa03459-95f9-477b-8f65-26d299294059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:11.516138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa03459-95f9-477b-8f65-26d299294059 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:11.531234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 943/1881] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:11.826802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343753-3975-4c87-8942-add37aff0eba None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:11.828993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-41343753-3975-4c87-8942-add37aff0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:11.860789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41343753-3975-4c87-8942-add37aff0eba None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:11.866600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:11.867223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:11.867499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:11.867768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] PATH_INFO: `/v3/projects/c42595be79b448159149cb7663e79cb9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:11.868938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42595be79b448159149cb7663e79cb9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:11.870833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:11.940226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:11.953210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42595be79b448159149cb7663e79cb9', 'request_id': 'req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.963134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42595be79b448159149cb7663e79cb9', 'request_id': 'req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.970898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42595be79b448159149cb7663e79cb9', 'request_id': 'req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.992592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] The token cache is being invalidate because project c42595be79b448159149cb7663e79cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:11.992592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.992592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cd46ce2d-d8ea-4a56-adcc-dd65a6910418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:11.995911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 939/1882] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:11 2022] DELETE /identity/v3/projects/c42595be79b448159149cb7663e79cb9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:12.001208 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.001208 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.001358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.028207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:12.029633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:12.150443 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 944/1883] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:12.157986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.158260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.158535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.184418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:12.186049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:12.223906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 940/1884] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:12.225247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.238343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4cb75-1f21-4497-a47a-89d5061cd4bc None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.248189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.248892 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.249240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.249524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.250177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:12.250482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.254243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.270038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 945/1885] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:12.274755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.287477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a9847-fb49-4356-917b-f500390ffd10 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.296910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.297683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.297964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.298243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.299443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.302151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.351124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 941/1886] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:12.353107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.374319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e41aa-8ef8-4553-841b-a6c24ef083ae admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.534361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.535081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.535448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.535914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.538581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.540959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.570905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 946/1887] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:12 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:12.582428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.595069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294c9d-3fab-41eb-89b7-cb9ed71a14b0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.603335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.604082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.604456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.604799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.605519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.607198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.619810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 942/1888] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:12.624055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.636800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b1327-6646-4204-aec2-e0bb453fadca admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.642143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5bc92-806b-4b70-bb7f-e9e8bcd30d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.642882 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5bc92-806b-4b70-bb7f-e9e8bcd30d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.643065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5bc92-806b-4b70-bb7f-e9e8bcd30d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.644022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5bc92-806b-4b70-bb7f-e9e8bcd30d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.644237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5bc92-806b-4b70-bb7f-e9e8bcd30d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.645765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5bc92-806b-4b70-bb7f-e9e8bcd30d10 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.659164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 947/1889] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:12.663954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.675818 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70ac8-d6e0-4231-8bc1-19b52d49dd32 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.682284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.682966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.683253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.683572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] PATH_INFO: `/v3/projects/1e8e9b6335524b04a99c2395ce5ea2ab/users/fc0bc069598f45d3a74cdd6ade042a12/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.701587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8e9b6335524b04a99c2395ce5ea2ab, user_id=fc0bc069598f45d3a74cdd6ade042a12, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.704760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.720809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 943/1890] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:12 2022] PUT /identity/v3/projects/1e8e9b6335524b04a99c2395ce5ea2ab/users/fc0bc069598f45d3a74cdd6ade042a12/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:12.732891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.733284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.733650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.756704 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:12.766727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] MFA Rules not processed for user `fc0bc069598f45d3a74cdd6ade042a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:12.768233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:12.844467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 948/1891] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:12.849601 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.923988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486a84e-61f0-4413-ac8b-29fe95ffc344 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:12.928900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:12.929510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:12.929788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:12.930058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:12.930683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:12.933034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:12.968211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 944/1892] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:12 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:12.972966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:12.989050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58da71-cbc5-4770-b46e-a503dd1eb3da None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.072029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.072762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.073070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.073354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.074049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.076289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.111157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 949/1893] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:12 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:13.115078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.135341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008e857-d44c-46a0-957f-7bf7d8377f1e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.148963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.150309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.150830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.151841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.152619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.154242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.167009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 945/1894] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:13.170987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.183230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67599-5721-4511-82c1-1dc16ed7b8bd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.188048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb411ac-bea0-4d96-bcac-3c3284a1dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.188835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb411ac-bea0-4d96-bcac-3c3284a1dae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.189232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb411ac-bea0-4d96-bcac-3c3284a1dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.189633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb411ac-bea0-4d96-bcac-3c3284a1dae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.190966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb411ac-bea0-4d96-bcac-3c3284a1dae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.192687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb411ac-bea0-4d96-bcac-3c3284a1dae6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.208819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 950/1895] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:13.209260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.220483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9bdd-2709-4f59-af11-82560038f945 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.225482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.226220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.226573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.226915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] PATH_INFO: `/v3/projects/c1eee6ddf290431b8785efd74f36b242/users/d41ab7a5ce764bce8b660ef80e8c1e04/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.243940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eee6ddf290431b8785efd74f36b242, user_id=d41ab7a5ce764bce8b660ef80e8c1e04, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.246780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.267917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 946/1896] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:13 2022] PUT /identity/v3/projects/c1eee6ddf290431b8785efd74f36b242/users/d41ab7a5ce764bce8b660ef80e8c1e04/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:13.280074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.280391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.280675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.314672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] MFA Rules not processed for user `d41ab7a5ce764bce8b660ef80e8c1e04`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:13.315802 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:13.390940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 951/1897] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:13.395500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.417355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:13.465191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6dae-9f90-4810-9ccd-c75c523a4df7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.470165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.470890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.471263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.471600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.472299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.474414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.508452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 947/1898] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:13 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:13.510163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.523861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf9945-7d3f-4757-bd37-b73b83a2921c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.538983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:13.627261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.627899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.628178 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.628493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.629141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.631311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.667105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 952/1899] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:13 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:13.667209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.678260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9514d-76b8-474c-b31c-b3a9098870d9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.685365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.686095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.686388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.686931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.687946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.689569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.715556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 948/1900] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:13.716772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.731124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb993-0772-4703-89c0-3364d1ec357b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.737250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.740417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.740727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.741003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] PATH_INFO: `/v3/projects/f72aec8e50e44da6acd5f90595fe505c/users/1a90e879ab02423eb470fc74b7fdbc06/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.770395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72aec8e50e44da6acd5f90595fe505c, user_id=1a90e879ab02423eb470fc74b7fdbc06, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.775335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.804842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 953/1901] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:13 2022] PUT /identity/v3/projects/f72aec8e50e44da6acd5f90595fe505c/users/1a90e879ab02423eb470fc74b7fdbc06/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:13.808608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.819919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b904780-f460-4ca5-be01-92704cf9e546 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.918188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214d2b2-bae2-4fbd-8578-0d0208114ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.918952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d2b2-bae2-4fbd-8578-0d0208114ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.919486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d2b2-bae2-4fbd-8578-0d0208114ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.919853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d2b2-bae2-4fbd-8578-0d0208114ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.920803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214d2b2-bae2-4fbd-8578-0d0208114ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.922481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214d2b2-bae2-4fbd-8578-0d0208114ba6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.937716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 949/1902] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:13.941905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:13.961085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dfbe9-6190-4ec4-b040-3e36d3603155 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:13.981242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:13.981749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:13.982026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:13.982304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] PATH_INFO: `/v3/projects/f72aec8e50e44da6acd5f90595fe505c/users/1a90e879ab02423eb470fc74b7fdbc06/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:13.984745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72aec8e50e44da6acd5f90595fe505c, user_id=1a90e879ab02423eb470fc74b7fdbc06, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:13.987627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:13.999534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 954/1903] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:13 2022] PUT /identity/v3/projects/f72aec8e50e44da6acd5f90595fe505c/users/1a90e879ab02423eb470fc74b7fdbc06/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:14.012078 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:14.012885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:14.013804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:14.063536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] MFA Rules not processed for user `1a90e879ab02423eb470fc74b7fdbc06`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:14.068058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:14.198510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 950/1904] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:14.217639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:14.221421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:14.296587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5b5ce-66e7-461d-8b3b-a84e9954f64f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:14.300391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:14.301012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:14.301294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:14.301567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:14.380357 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:14.384751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:14.400321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 955/1905] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:15.985443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:15.987111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:16.000020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae7079-db90-41b9-9cbb-0b2823cf85ee None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:16.007180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:16.007802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:16.008074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:16.008362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:16.017327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:16.065703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:16.067122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:16.077775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 951/1906] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:16.633235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:16.638004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:16.658651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:16.743467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319e9a-5d06-49d3-b2f4-96e06ea5b35e service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:16.748899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:16.749162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:16.749438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:16.749718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] PATH_INFO: `/v3/users/ad333b340f8c449f80083e273b382c83` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:16.750914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad333b340f8c449f80083e273b382c83)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:16.752990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:16.768504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:16.778189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f16ba8-067e-4ef9-b229-4f80041f4ca4 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:16.784931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f17a8-65a4-4e20-8fd2-62ba0c2ff13a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:16.785577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f17a8-65a4-4e20-8fd2-62ba0c2ff13a service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:16.786342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f17a8-65a4-4e20-8fd2-62ba0c2ff13a service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:16.786342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f17a8-65a4-4e20-8fd2-62ba0c2ff13a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:16.804134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f17a8-65a4-4e20-8fd2-62ba0c2ff13a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:16.805705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f17a8-65a4-4e20-8fd2-62ba0c2ff13a service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:16.818685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 952/1907] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:06:16.842187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad333b340f8c449f80083e273b382c83'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:16.873362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad333b340f8c449f80083e273b382c83'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:16.875004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad333b340f8c449f80083e273b382c83'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:16.888604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad333b340f8c449f80083e273b382c83'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:16.899651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad333b340f8c449f80083e273b382c83'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:16.907047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 956/1908] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:16 2022] DELETE /identity/v3/users/ad333b340f8c449f80083e273b382c83 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:16.911350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:16.911632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:16.911908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:16.932366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:16.933613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:16.998764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 953/1909] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:17.009100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.010578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:17.067779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf662af-6479-4603-a011-8762913c11c5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.071933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b14dd6-e6e9-4ca1-ba6e-90621ad63e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.072570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b14dd6-e6e9-4ca1-ba6e-90621ad63e9a service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.072850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b14dd6-e6e9-4ca1-ba6e-90621ad63e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.073120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b14dd6-e6e9-4ca1-ba6e-90621ad63e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.082135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b14dd6-e6e9-4ca1-ba6e-90621ad63e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.083613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b14dd6-e6e9-4ca1-ba6e-90621ad63e9a service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:17.094335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 957/1910] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:17.404991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.406767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:17.438378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e1f33-f9ae-4a9f-943c-31c91ce2dd5d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.445375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.446099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.446252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.446526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] PATH_INFO: `/v3/projects/58ae406e119d4d1a886598feb337473e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.448414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ae406e119d4d1a886598feb337473e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.450960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:17.521312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ae406e119d4d1a886598feb337473e', 'request_id': 'req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:17.530035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ae406e119d4d1a886598feb337473e', 'request_id': 'req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:17.535856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ae406e119d4d1a886598feb337473e', 'request_id': 'req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:17.548310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] The token cache is being invalidate because project 58ae406e119d4d1a886598feb337473e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:17.548625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:17.549268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-218b15ef-4e2d-4ecf-9dfe-60c278b9070f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:17.550786 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 954/1911] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:17 2022] DELETE /identity/v3/projects/58ae406e119d4d1a886598feb337473e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:17.556390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.556660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.556937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.585688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:17.586920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:17.649839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:17.681640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 958/1912] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:17.691274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.691617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.691965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.713159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:17.714470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:17.722777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 955/1913] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:17.727621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.742415 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950d99b-aebd-451a-ad34-eedda26c7152 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.747372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.747994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.748276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.748581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.749269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:17.749569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.751232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:17.766492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 959/1914] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:17.767600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.777683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f6ee-4097-4f40-a81d-b0d3c13db689 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.783211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.783844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.784120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.784424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.785074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.786987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:17.800179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:17.820366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 956/1915] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:17 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:17.824728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.837901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f358c-d7e7-449e-a814-7bc663453e74 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.901587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.902199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.902473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.902738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.903400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.905362 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:17.928800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 960/1916] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:17 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:17.932864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.943785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327ce07-887c-4e63-adc2-e79f634e72bc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.948565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.949165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.949446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.949720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.950359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.951941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:17.964370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 957/1917] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:17.966607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:17.984737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fa4b-1fa1-4f17-8def-6cf0eb82f2d4 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:17.990181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7055-70ca-4997-b6a5-099c9c576983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:17.990790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7055-70ca-4997-b6a5-099c9c576983 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:17.991066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7055-70ca-4997-b6a5-099c9c576983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:17.991337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7055-70ca-4997-b6a5-099c9c576983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:17.992006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b7055-70ca-4997-b6a5-099c9c576983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:17.993611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b7055-70ca-4997-b6a5-099c9c576983 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:18.005167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 961/1918] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:18.010004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:18.021305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f299-4fbc-4c11-bbd1-b5e91158ab4c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:18.027330 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:18.028099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:18.028645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:18.029131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] PATH_INFO: `/v3/projects/b71bb7b4654d4d3c9eaa2bbe64a12f67/users/85c595e5382646d2a0a91979a51abe35/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:18.048252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71bb7b4654d4d3c9eaa2bbe64a12f67, user_id=85c595e5382646d2a0a91979a51abe35, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:18.051392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:18.072435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 958/1919] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:18 2022] PUT /identity/v3/projects/b71bb7b4654d4d3c9eaa2bbe64a12f67/users/85c595e5382646d2a0a91979a51abe35/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:18.080584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:18.081131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:18.081501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:18.117940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] MFA Rules not processed for user `85c595e5382646d2a0a91979a51abe35`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:18.119555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:18.205865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 962/1920] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:18.251693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:18.258170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:18.344564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130929a-1d3b-474e-b7fa-7a8c5fc7991b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:18.348209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:18.348868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:18.349180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:18.349487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:18.366182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:18.367630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:18.379573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 959/1921] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:20.599137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:20.611277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52538371-db7c-49ac-884a-c861adc56b5e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:20.627877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:20.628850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:20.629277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:20.629700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:20.632783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:20.680297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:20.723899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:20.726011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e5cef-eef7-425f-8596-b60dc6732806 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:20.736029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 963/1922] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:20.993896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:20.995503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:21.061199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49e46a-69b6-4172-a931-1b2a52917611 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:21.065707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:21.066335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:21.066615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:21.066882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] PATH_INFO: `/v3/users/fc0bc069598f45d3a74cdd6ade042a12` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:21.067988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0bc069598f45d3a74cdd6ade042a12)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:21.069961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:21.141136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0bc069598f45d3a74cdd6ade042a12'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.159217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:21.163035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0bc069598f45d3a74cdd6ade042a12'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.163948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0bc069598f45d3a74cdd6ade042a12'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.181142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0bc069598f45d3a74cdd6ade042a12'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.195362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0bc069598f45d3a74cdd6ade042a12'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.223949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 960/1923] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:20 2022] DELETE /identity/v3/users/fc0bc069598f45d3a74cdd6ade042a12 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:21.226190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:21.226822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:21.227303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:21.251114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:21.253751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:21.330838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 964/1924] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:21.343366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:21.345013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:21.444585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31836e-c2f9-4e6d-a396-669f8142b734 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:21.448074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:21.448929 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:21.449212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:21.449486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:21.460184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:21.461715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:21.486218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 961/1925] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:21.833092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:21.835101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:21.847550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9983-888a-4531-9720-3dd1cdff86f5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:21.853315 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:21.854075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:21.854354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:21.854624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] PATH_INFO: `/v3/projects/1e8e9b6335524b04a99c2395ce5ea2ab` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:21.855728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8e9b6335524b04a99c2395ce5ea2ab)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:21.857659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:21.915942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8e9b6335524b04a99c2395ce5ea2ab', 'request_id': 'req-a9bc67dc-7523-4351-bd5d-ff0dbac80432'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.923249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8e9b6335524b04a99c2395ce5ea2ab', 'request_id': 'req-a9bc67dc-7523-4351-bd5d-ff0dbac80432'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.928971 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8e9b6335524b04a99c2395ce5ea2ab', 'request_id': 'req-a9bc67dc-7523-4351-bd5d-ff0dbac80432'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.944827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] The token cache is being invalidate because project 1e8e9b6335524b04a99c2395ce5ea2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:21.945125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.945794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:21.947603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 965/1926] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:21 2022] DELETE /identity/v3/projects/1e8e9b6335524b04a99c2395ce5ea2ab => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:21.951642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:21.961864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80447e-cc26-49d1-b5a0-e6d37efe1668 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:22.021254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:22.022411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:22.022683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:22.022972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] PATH_INFO: `/v3/users/d41ab7a5ce764bce8b660ef80e8c1e04` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:22.024104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41ab7a5ce764bce8b660ef80e8c1e04)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:22.026075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:22.073844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41ab7a5ce764bce8b660ef80e8c1e04'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.088055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41ab7a5ce764bce8b660ef80e8c1e04'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.088906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41ab7a5ce764bce8b660ef80e8c1e04'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.098611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41ab7a5ce764bce8b660ef80e8c1e04'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.107163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41ab7a5ce764bce8b660ef80e8c1e04'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.109695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:22.114988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 962/1927] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:21 2022] DELETE /identity/v3/users/d41ab7a5ce764bce8b660ef80e8c1e04 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:22.481663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:22.483286 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:22.500291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc67dc-7523-4351-bd5d-ff0dbac80432 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:22.572580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:22.589280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:22.590004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:22.590284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:22.590555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] PATH_INFO: `/v3/projects/c1eee6ddf290431b8785efd74f36b242` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:22.591710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eee6ddf290431b8785efd74f36b242)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:22.594016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:22.646540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eee6ddf290431b8785efd74f36b242', 'request_id': 'req-d804428e-00ef-4e01-ad99-4c168903e938'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.656782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eee6ddf290431b8785efd74f36b242', 'request_id': 'req-d804428e-00ef-4e01-ad99-4c168903e938'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.662537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eee6ddf290431b8785efd74f36b242', 'request_id': 'req-d804428e-00ef-4e01-ad99-4c168903e938'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.675552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] The token cache is being invalidate because project c1eee6ddf290431b8785efd74f36b242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:22.675842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.676696 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.678763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 966/1928] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:22 2022] DELETE /identity/v3/projects/c1eee6ddf290431b8785efd74f36b242 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:22.682898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:22.684379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:22.697692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44ff0c-08b0-4969-819f-b54ed78b28a2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:22.763389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:22.764356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:22.764641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:22.764912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] PATH_INFO: `/v3/users/1a90e879ab02423eb470fc74b7fdbc06` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:22.766052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a90e879ab02423eb470fc74b7fdbc06)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:22.767984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:22.818400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a90e879ab02423eb470fc74b7fdbc06'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.831954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a90e879ab02423eb470fc74b7fdbc06'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.832658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a90e879ab02423eb470fc74b7fdbc06'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.839947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a90e879ab02423eb470fc74b7fdbc06'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.848033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26db4b76-b2be-41ce-ad90-474b971b82f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a90e879ab02423eb470fc74b7fdbc06'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:22.854787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 963/1929] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:22 2022] DELETE /identity/v3/users/1a90e879ab02423eb470fc74b7fdbc06 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:23.167888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.170294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:23.185828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804428e-00ef-4e01-ad99-4c168903e938 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.252093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.252759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.253038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.253313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] PATH_INFO: `/v3/projects/f72aec8e50e44da6acd5f90595fe505c` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.254636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72aec8e50e44da6acd5f90595fe505c)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.257168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.318354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72aec8e50e44da6acd5f90595fe505c', 'request_id': 'req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.326131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72aec8e50e44da6acd5f90595fe505c', 'request_id': 'req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.331815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72aec8e50e44da6acd5f90595fe505c', 'request_id': 'req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.343096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] The token cache is being invalidate because project f72aec8e50e44da6acd5f90595fe505c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:23.343414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.344020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7ee71feb-cf6d-4fcb-b9e4-e572e1c0ecf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.345643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 967/1930] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:23 2022] DELETE /identity/v3/projects/f72aec8e50e44da6acd5f90595fe505c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:23.351001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.351467 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.351558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.372485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:23.373733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:23.443325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 964/1931] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:23.452001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.452289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.452632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.472305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:23.473536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:23.481665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 968/1932] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:23.485879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.498507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a261c-65f4-4fd2-83e5-2b24536903a9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.503260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.503871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.504171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.504476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.505219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:23.505413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.507628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.519825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 965/1933] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:23.524452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.530812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:23.535578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658d00-cc46-481f-b0ce-910d7f49e897 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.542994 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.543735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.544095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.545370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.546139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.548425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.579756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 969/1934] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:23 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:23.583938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.594494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245d44-a8af-49fd-b966-4ed5619d76b8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.598713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:23.621763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.623864 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:23.679461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.680239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.680646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.681167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.681711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.683929 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.698075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb913-69f8-4c26-a9ee-59f7bb1bf980 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.703469 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.704166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.704542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.704885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] PATH_INFO: `/v3/users/85c595e5382646d2a0a91979a51abe35` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.706117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c595e5382646d2a0a91979a51abe35)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.708126 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.722875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 966/1935] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:23 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:23.725943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.750685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd66fd-e88f-4c1d-95e8-e8d4661cb4b1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.771321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.772174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.772586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.773168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.774049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.777874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.806913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c595e5382646d2a0a91979a51abe35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.808411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 967/1936] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:23.812465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.826548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb38e9-725f-4acf-9985-6bfa427d8685 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.828126 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c595e5382646d2a0a91979a51abe35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.829809 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c595e5382646d2a0a91979a51abe35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.831974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.832918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.833308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.834166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.834637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.836890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.850597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 968/1937] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:23.851851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c595e5382646d2a0a91979a51abe35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.854651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:23.863947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-28ce1e3c-9e44-461a-b8d7-4e7e7cf880af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c595e5382646d2a0a91979a51abe35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:23.868506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80332-7738-4328-8763-b67a6ef2ab46 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:23.873563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 970/1938] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:23 2022] DELETE /identity/v3/users/85c595e5382646d2a0a91979a51abe35 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:23.877795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.878081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.878356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.878733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2fde-1adc-4ac5-9275-141ca17b4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:23.879593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2fde-1adc-4ac5-9275-141ca17b4323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.880227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2fde-1adc-4ac5-9275-141ca17b4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.880707 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2fde-1adc-4ac5-9275-141ca17b4323 admin admin] PATH_INFO: `/v3/projects/827c1d25b7884104823d0b8b28fea929/users/1912adc7cf454dc4824969d5ec1b5f35/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:23.899998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:23.901267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:23.916822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea2fde-1adc-4ac5-9275-141ca17b4323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827c1d25b7884104823d0b8b28fea929, user_id=1912adc7cf454dc4824969d5ec1b5f35, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:23.916822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea2fde-1adc-4ac5-9275-141ca17b4323 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:23.968909 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 969/1939] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:23 2022] PUT /identity/v3/projects/827c1d25b7884104823d0b8b28fea929/users/1912adc7cf454dc4824969d5ec1b5f35/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:23.973663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:23.974498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:23.975014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:24.013050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 971/1940] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:24.022829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:24.024227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:24.025485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] MFA Rules not processed for user `1912adc7cf454dc4824969d5ec1b5f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:24.027198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:24.029177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:24.118795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 970/1941] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:24.124550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b1826-1f5e-4272-9f06-b95f5c71605b None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:24.130867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:24.133097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:24.184622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:24.201962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95109-945d-4cf0-a89a-9634c4180075 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:24.205387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa657714-fff4-43aa-9bd5-681a31468df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:24.205883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:24.206150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa657714-fff4-43aa-9bd5-681a31468df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:24.206496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:24.206697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa657714-fff4-43aa-9bd5-681a31468df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:24.206876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa657714-fff4-43aa-9bd5-681a31468df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:24.207104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:24.207718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:24.225396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:24.227642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:24.239902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 971/1942] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:06:24.332563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa657714-fff4-43aa-9bd5-681a31468df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:24.334310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa657714-fff4-43aa-9bd5-681a31468df8 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:24.349076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 972/1943] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:06:24.788820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:24.803814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:24.822507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98c43-cdc3-4c0c-9ca1-72e48c86dddc service glance] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:24.829528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:24.830361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:24.830817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:24.831767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] PATH_INFO: `/v3/projects/b71bb7b4654d4d3c9eaa2bbe64a12f67` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:24.836227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b71bb7b4654d4d3c9eaa2bbe64a12f67)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:24.838714 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:25.013923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b71bb7b4654d4d3c9eaa2bbe64a12f67', 'request_id': 'req-00cad89c-88f6-4c95-ae5d-e74d1792dafc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:25.026581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b71bb7b4654d4d3c9eaa2bbe64a12f67', 'request_id': 'req-00cad89c-88f6-4c95-ae5d-e74d1792dafc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:25.040907 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b71bb7b4654d4d3c9eaa2bbe64a12f67', 'request_id': 'req-00cad89c-88f6-4c95-ae5d-e74d1792dafc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:25.074579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] The token cache is being invalidate because project b71bb7b4654d4d3c9eaa2bbe64a12f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:25.074873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:25.075554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:25.077204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 972/1944] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:24 2022] DELETE /identity/v3/projects/b71bb7b4654d4d3c9eaa2bbe64a12f67 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:31.895509 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:31.896057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:31.896275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:31.917690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:31.918900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:31.981591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 973/1945] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:06:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:32.030334 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:32.032307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:32.109182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad89c-88f6-4c95-ae5d-e74d1792dafc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:32.116052 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb46da8-5536-4c6e-a927-2590155b805a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:32.116511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb46da8-5536-4c6e-a927-2590155b805a service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:32.116875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb46da8-5536-4c6e-a927-2590155b805a service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:32.117064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb46da8-5536-4c6e-a927-2590155b805a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:32.127826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb46da8-5536-4c6e-a927-2590155b805a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:32.129722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb46da8-5536-4c6e-a927-2590155b805a service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:32.138420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 973/1946] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:06:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:06:36.160180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:36.162375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:36.176159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:36.228491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ee6c1-bd78-4f7a-b7d0-4fa5c34f14e7 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:36.233243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:36.233875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:36.234175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:36.234444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] PATH_INFO: `/v3/users/b201d89f776641268684a61b680e2a4e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:36.235563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b201d89f776641268684a61b680e2a4e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:36.237776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:36.288214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b201d89f776641268684a61b680e2a4e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:36.301908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b201d89f776641268684a61b680e2a4e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:36.302901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b201d89f776641268684a61b680e2a4e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:36.309913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b201d89f776641268684a61b680e2a4e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:36.318297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b201d89f776641268684a61b680e2a4e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:36.324679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 974/1947] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:36 2022] DELETE /identity/v3/users/b201d89f776641268684a61b680e2a4e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:36.329149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:36.329698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:36.330005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:36.352990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:36.354196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:36.411811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:36.430373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 974/1948] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:36.440571 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:36.442006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:36.513922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da63696-50d6-49db-89f9-798e8075d012 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:36.520168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:36.521186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:36.522114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:36.523109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:36.536356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:36.537898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:36.556135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 975/1949] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:37.001008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:37.002475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:37.023992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5acd1-45eb-4233-b4bb-40b26cdbd5a6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:37.038539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:37.050210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.050613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.051767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] PATH_INFO: `/v3/projects/4a99608a9fcc4c25bc9c6b04eb3bdadc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:37.053207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a99608a9fcc4c25bc9c6b04eb3bdadc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:37.055132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:37.115035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a99608a9fcc4c25bc9c6b04eb3bdadc', 'request_id': 'req-b121bf23-486b-4fd0-b02d-ddd87018df42'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.138727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a99608a9fcc4c25bc9c6b04eb3bdadc', 'request_id': 'req-b121bf23-486b-4fd0-b02d-ddd87018df42'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.150603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a99608a9fcc4c25bc9c6b04eb3bdadc', 'request_id': 'req-b121bf23-486b-4fd0-b02d-ddd87018df42'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.167679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] The token cache is being invalidate because project 4a99608a9fcc4c25bc9c6b04eb3bdadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:37.167973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.168724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.173034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 975/1950] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:36 2022] DELETE /identity/v3/projects/4a99608a9fcc4c25bc9c6b04eb3bdadc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:37.174212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:37.180055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:37.181553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:37.196688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8a4f-f9be-4159-ac43-c5b997de52b6 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:37.230974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:37.260055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121bf23-486b-4fd0-b02d-ddd87018df42 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:37.267234 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:37.267578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:37.267888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.268175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.268691 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] PATH_INFO: `/v3/users/96838394906d4020b1e692d3afa8cea0` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:37.269859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.270172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96838394906d4020b1e692d3afa8cea0)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:37.270316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.270479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] PATH_INFO: `/v3/users/6f91d5207d774a87b645dc346b4ed512` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:37.271780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f91d5207d774a87b645dc346b4ed512)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:37.272098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:37.273737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:37.335872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96838394906d4020b1e692d3afa8cea0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.340007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f91d5207d774a87b645dc346b4ed512'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.354128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96838394906d4020b1e692d3afa8cea0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.354920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96838394906d4020b1e692d3afa8cea0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.356619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f91d5207d774a87b645dc346b4ed512'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.357310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f91d5207d774a87b645dc346b4ed512'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.365495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96838394906d4020b1e692d3afa8cea0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.367317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f91d5207d774a87b645dc346b4ed512'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.374692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5e50fbec-864f-473f-b212-3fe55822017c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96838394906d4020b1e692d3afa8cea0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.376400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:37.378024 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f91d5207d774a87b645dc346b4ed512'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.383426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 976/1951] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:37 2022] DELETE /identity/v3/users/96838394906d4020b1e692d3afa8cea0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:37.391330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 976/1952] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:37 2022] DELETE /identity/v3/users/6f91d5207d774a87b645dc346b4ed512 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:37.391548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.391548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.391548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:37.412210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:37.413783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:37.499335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 977/1953] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:37.514324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:37.516601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:37.591974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e374b-22ec-4806-9d4b-07456b91425b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:37.596497 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2a508-1ebc-47b7-98b2-40d67773a5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:37.597118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2a508-1ebc-47b7-98b2-40d67773a5fb service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.597404 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2a508-1ebc-47b7-98b2-40d67773a5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.597678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2a508-1ebc-47b7-98b2-40d67773a5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:37.609916 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2a508-1ebc-47b7-98b2-40d67773a5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:37.611388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2a508-1ebc-47b7-98b2-40d67773a5fb service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:37.623050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 977/1954] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:37.756459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:37.758274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:37.781970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b442d0-ca1c-4cf7-b5b2-a7bd7f5ebe3d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:37.819282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:37.819969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.820255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.820564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] PATH_INFO: `/v3/projects/c67afd7333fb4d0dae07376f9acc5520` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:37.823013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67afd7333fb4d0dae07376f9acc5520)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:37.824989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:37.900180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67afd7333fb4d0dae07376f9acc5520', 'request_id': 'req-7206743e-e353-4392-a8f1-5964c4b25802'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.916973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67afd7333fb4d0dae07376f9acc5520', 'request_id': 'req-7206743e-e353-4392-a8f1-5964c4b25802'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.927112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67afd7333fb4d0dae07376f9acc5520', 'request_id': 'req-7206743e-e353-4392-a8f1-5964c4b25802'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.957405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] The token cache is being invalidate because project c67afd7333fb4d0dae07376f9acc5520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:37.957940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.958785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:37.961626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 978/1955] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:37 2022] DELETE /identity/v3/projects/c67afd7333fb4d0dae07376f9acc5520 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:37.973267 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ae422-b935-44ff-a77c-408237a8e9b5 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:37.973702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ae422-b935-44ff-a77c-408237a8e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:37.974613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ae422-b935-44ff-a77c-408237a8e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.013825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-866ae422-b935-44ff-a77c-408237a8e9b5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:38.016190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-866ae422-b935-44ff-a77c-408237a8e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:38.126635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:38.137150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.142764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:38.194640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 978/1956] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:38.209131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.209665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.209775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.241089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:38.243004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:38.259783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 979/1957] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:38.265420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.277412 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40d480-58e6-45a4-bf24-3a5c3ad00aa6 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.292168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.292830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.293115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.293384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.294048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:38.294398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.295937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.318504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 980/1958] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:38.323148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.341797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5487-bea8-4825-ba37-b1fec0937ae2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.347834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.348675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.349026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.353994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206743e-e353-4392-a8f1-5964c4b25802 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.358709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.359476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.361903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.367746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.368480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.368770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.369186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] PATH_INFO: `/v3/projects/565ae53c7aee4c469d7b45f692747fab` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.378038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565ae53c7aee4c469d7b45f692747fab)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.385337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.408702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 981/1959] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:38 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:38.414403 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.459763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:38.520162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565ae53c7aee4c469d7b45f692747fab', 'request_id': 'req-676176ab-8138-4281-9bff-dc1a579e6e96'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:38.529466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851f3b-d4fc-4069-ade5-5131a5acb5f5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.535266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565ae53c7aee4c469d7b45f692747fab', 'request_id': 'req-676176ab-8138-4281-9bff-dc1a579e6e96'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:38.551359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565ae53c7aee4c469d7b45f692747fab', 'request_id': 'req-676176ab-8138-4281-9bff-dc1a579e6e96'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:38.575567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] The token cache is being invalidate because project 565ae53c7aee4c469d7b45f692747fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:38.576479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:38.577249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:38.579313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 979/1960] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:38 2022] DELETE /identity/v3/projects/565ae53c7aee4c469d7b45f692747fab => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:38.662589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.663288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.663579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.663853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.664618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.669153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.701022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 982/1961] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:38 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:38.701745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.703621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:38.743189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676176ab-8138-4281-9bff-dc1a579e6e96 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.755328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.757034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.757323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.758012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.758886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.760852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.781992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 980/1962] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:38.785789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.805172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7bc3e-ae65-4f2c-ab1e-2ed63ee54dae admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.821889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bcff-1ce0-4908-b650-fa6c2a88667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.823117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bcff-1ce0-4908-b650-fa6c2a88667b admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.823695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bcff-1ce0-4908-b650-fa6c2a88667b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.824299 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bcff-1ce0-4908-b650-fa6c2a88667b admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.825623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bcff-1ce0-4908-b650-fa6c2a88667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.827765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bcff-1ce0-4908-b650-fa6c2a88667b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.845603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 983/1963] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:38.848998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:38.878666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced78f-a553-47a8-a9ba-200a4c570250 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:38.884813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:38.885607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.885990 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.886373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] PATH_INFO: `/v3/projects/aa9dea9eeb144e218e230b97d9d2dda2/users/61700e9c2dc6422eb01c0c8e8f2b1edd/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.904181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9dea9eeb144e218e230b97d9d2dda2, user_id=61700e9c2dc6422eb01c0c8e8f2b1edd, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:38.907587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:38.926900 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 981/1964] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:38 2022] PUT /identity/v3/projects/aa9dea9eeb144e218e230b97d9d2dda2/users/61700e9c2dc6422eb01c0c8e8f2b1edd/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:38.938844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:38.939133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:38.939406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:38.978662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] MFA Rules not processed for user `61700e9c2dc6422eb01c0c8e8f2b1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:38.979944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:39.014583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:39.056153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 984/1965] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:39.060681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.157773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9163-c860-492f-b742-d88b2eab7bbf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.168039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.168859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.169985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.170299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.170841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.172808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.206561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 982/1966] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:39 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:39.208020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.220393 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90cbb-4483-4437-8f22-d571aa8951f2 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.305478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.306015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.306298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.306574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.307209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.309222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.338521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 985/1967] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:39 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:39.342496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.354709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8da23f-2c06-4627-83a9-26fa0b910622 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.359626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.360226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.360606 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.360884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.361515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.363385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.378822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 983/1968] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:39.383025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.394651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e1714-2de6-4b86-a72a-124c7256214c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.399522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.400177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.400488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.400766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] PATH_INFO: `/v3/projects/dc07b19b49534a0bb8c24d611c724d76/users/1978ba5763e14d2bb79340533b80d26d/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.417137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07b19b49534a0bb8c24d611c724d76, user_id=1978ba5763e14d2bb79340533b80d26d, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.419826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.435444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 986/1969] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:39 2022] PUT /identity/v3/projects/dc07b19b49534a0bb8c24d611c724d76/users/1978ba5763e14d2bb79340533b80d26d/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:39.439789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.452061 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ddb1-56e7-44a2-9d36-967a83ddfb80 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.507839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:39.520160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cc403-aef5-4652-99df-147de67dbc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.521081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cc403-aef5-4652-99df-147de67dbc89 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.521214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cc403-aef5-4652-99df-147de67dbc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.521493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cc403-aef5-4652-99df-147de67dbc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.522688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cc403-aef5-4652-99df-147de67dbc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.524394 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cc403-aef5-4652-99df-147de67dbc89 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.535085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 984/1970] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:39.541395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.554329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd5cf-e3cc-4bc3-a104-4a259565ddfe admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.559505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.560191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.560773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.561371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] PATH_INFO: `/v3/projects/dc07b19b49534a0bb8c24d611c724d76/users/1978ba5763e14d2bb79340533b80d26d/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.563128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07b19b49534a0bb8c24d611c724d76, user_id=1978ba5763e14d2bb79340533b80d26d, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.565944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.578616 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 987/1971] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:39 2022] PUT /identity/v3/projects/dc07b19b49534a0bb8c24d611c724d76/users/1978ba5763e14d2bb79340533b80d26d/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:39.589749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.590125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.590476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.624940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] MFA Rules not processed for user `1978ba5763e14d2bb79340533b80d26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:39.626374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:39.717154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 985/1972] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:39.726244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.728157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:39.818019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a07a-6f19-436f-a2d0-16aa137ca13d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.824977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.826883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.827418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.827711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:39.844145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:39.846812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:39.864519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 988/1973] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:39.972148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:39.986036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dafad-79a7-4938-a620-554b97dee299 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:39.994711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b5a4b-7286-42d3-b5bc-427639480023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:39.995345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b5a4b-7286-42d3-b5bc-427639480023 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:39.995667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b5a4b-7286-42d3-b5bc-427639480023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:39.995945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b5a4b-7286-42d3-b5bc-427639480023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:40.096477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b5a4b-7286-42d3-b5bc-427639480023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:40.098140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b5a4b-7286-42d3-b5bc-427639480023 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:40.112869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 986/1974] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:43.890985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:43.924759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:43.962702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8ee33-ec87-4a6e-b9a8-a308f1d4ca48 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:43.967480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:43.968108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:43.968416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:43.968689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] PATH_INFO: `/v3/users/61700e9c2dc6422eb01c0c8e8f2b1edd` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:43.969792 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61700e9c2dc6422eb01c0c8e8f2b1edd)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:43.971698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:44.017889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61700e9c2dc6422eb01c0c8e8f2b1edd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:44.031137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61700e9c2dc6422eb01c0c8e8f2b1edd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:44.031950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61700e9c2dc6422eb01c0c8e8f2b1edd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:44.040511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61700e9c2dc6422eb01c0c8e8f2b1edd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:44.050694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61700e9c2dc6422eb01c0c8e8f2b1edd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:44.059360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 989/1975] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:43 2022] DELETE /identity/v3/users/61700e9c2dc6422eb01c0c8e8f2b1edd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:44.063891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:44.064425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:44.064586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:44.084556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:44.085761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:44.144846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 987/1976] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:44.155043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:44.156784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:44.294379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570e5a-99c2-4aac-8d3e-2f8485db5736 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:44.311434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:44.312500 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:44.312900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:44.313341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:44.357781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:44.359762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:44.405634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 990/1977] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:44.854091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:44.856842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:44.903764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc075-7665-4100-9d07-819adf6076fd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:44.930118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:44.930517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:44.930856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:44.931355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] PATH_INFO: `/v3/projects/aa9dea9eeb144e218e230b97d9d2dda2` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:44.947653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9dea9eeb144e218e230b97d9d2dda2)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:44.954721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:44.984249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:45.062739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9dea9eeb144e218e230b97d9d2dda2', 'request_id': 'req-a165e388-12af-4917-8edf-4ba633b40605'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.078315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9dea9eeb144e218e230b97d9d2dda2', 'request_id': 'req-a165e388-12af-4917-8edf-4ba633b40605'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.103739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9dea9eeb144e218e230b97d9d2dda2', 'request_id': 'req-a165e388-12af-4917-8edf-4ba633b40605'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.122924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] The token cache is being invalidate because project aa9dea9eeb144e218e230b97d9d2dda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:45.123264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.123948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.128761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 988/1978] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:44 2022] DELETE /identity/v3/projects/aa9dea9eeb144e218e230b97d9d2dda2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:45.129949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:45.143100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400d02-d443-4d3f-931c-a468ee626136 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:45.201951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:45.221894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:45.222531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:45.222804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:45.223072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] PATH_INFO: `/v3/users/1978ba5763e14d2bb79340533b80d26d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:45.224639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1978ba5763e14d2bb79340533b80d26d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:45.226227 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:45.325685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1978ba5763e14d2bb79340533b80d26d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.346213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1978ba5763e14d2bb79340533b80d26d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.347011 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1978ba5763e14d2bb79340533b80d26d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.357326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1978ba5763e14d2bb79340533b80d26d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.370586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-b0b1f1a7-162c-42db-b8ef-12011d519e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1978ba5763e14d2bb79340533b80d26d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:45.383753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 991/1979] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:45 2022] DELETE /identity/v3/users/1978ba5763e14d2bb79340533b80d26d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:45.792622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:45.794390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:45.815338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165e388-12af-4917-8edf-4ba633b40605 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:45.842565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0cd49-f86a-4458-984a-7a4db4cd3a77 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:45.843035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0cd49-f86a-4458-984a-7a4db4cd3a77 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:45.843463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0cd49-f86a-4458-984a-7a4db4cd3a77 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:45.845218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 992/1980] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:06:45.850422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:45.850886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:45.851309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:45.893583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:45.895135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:45.971515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:45.974179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:45.975199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:45.975577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] PATH_INFO: `/v3/projects/dc07b19b49534a0bb8c24d611c724d76` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:45.985895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc07b19b49534a0bb8c24d611c724d76)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:45.990443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.039788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 993/1981] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:46.040875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.053115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.086595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc07b19b49534a0bb8c24d611c724d76', 'request_id': 'req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.087209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483a601-83ea-4c20-a9b4-e0053c4135d5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.098423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc07b19b49534a0bb8c24d611c724d76', 'request_id': 'req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.108999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc07b19b49534a0bb8c24d611c724d76', 'request_id': 'req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.127826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] The token cache is being invalidate because project dc07b19b49534a0bb8c24d611c724d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:46.128378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.129129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.131170 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 989/1982] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:45 2022] DELETE /identity/v3/projects/dc07b19b49534a0bb8c24d611c724d76 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:46.132075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.133658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.174318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:46.195538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.196964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.197903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.198591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] PATH_INFO: `/v3/users/c94486003989491ab09da96dbb4a0ea7` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.203679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94486003989491ab09da96dbb4a0ea7)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.206448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.212807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:46.246775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7fbc-d88b-44a2-a1e1-d3bf3d3b9014 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.253639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.254263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.254638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.254836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.256842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.272186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.273880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934717b-4292-4a15-9aa8-4195948baf8f service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.276801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94486003989491ab09da96dbb4a0ea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.292235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 990/1983] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:46.293551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249706d-d44b-4f20-986a-4774b7ce5e93 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.293829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249706d-d44b-4f20-986a-4774b7ce5e93 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.294101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249706d-d44b-4f20-986a-4774b7ce5e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.295287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94486003989491ab09da96dbb4a0ea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.296377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94486003989491ab09da96dbb4a0ea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.307528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94486003989491ab09da96dbb4a0ea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.334148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b249706d-d44b-4f20-986a-4774b7ce5e93 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:46.334358 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94486003989491ab09da96dbb4a0ea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.335556 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b249706d-d44b-4f20-986a-4774b7ce5e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.344008 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 991/1984] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:46.352169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 994/1985] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:46 2022] DELETE /identity/v3/users/c94486003989491ab09da96dbb4a0ea7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:46.358813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.359069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.359358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.402183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:46.403667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.497894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 992/1986] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:46.498158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.522881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c786-8244-4b23-8d81-91f1bdc783e6 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.528475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.529661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.530221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.530686 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.531575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:46.532289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.534646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.558165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.564800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 995/1987] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:46.572006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff13e42-dcc3-4767-8f80-cfed39c64445 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.580706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.585066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.585653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.586151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.587328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.590928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.605760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.607532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.631162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c4ac9-0968-4e9f-a1c9-715b5e040619 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.643180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.643926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.644269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.645614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] PATH_INFO: `/v3/projects/d5afa9a537bc4d3aadda19e3e992ef1e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.648017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5afa9a537bc4d3aadda19e3e992ef1e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.652150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.659223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 993/1988] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:46 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:46.660572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.738537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5afa9a537bc4d3aadda19e3e992ef1e', 'request_id': 'req-f2b299f3-9e0c-4497-a907-6e7e21119651'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.752652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5afa9a537bc4d3aadda19e3e992ef1e', 'request_id': 'req-f2b299f3-9e0c-4497-a907-6e7e21119651'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.765459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3bedf-5551-4629-8db0-16d8e7cd2287 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.775250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5afa9a537bc4d3aadda19e3e992ef1e', 'request_id': 'req-f2b299f3-9e0c-4497-a907-6e7e21119651'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.799636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] The token cache is being invalidate because project d5afa9a537bc4d3aadda19e3e992ef1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:46.800220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.801407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:46.808052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 996/1989] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:46 2022] DELETE /identity/v3/projects/d5afa9a537bc4d3aadda19e3e992ef1e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:46.811271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:46.811447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.813650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.870687 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.872103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.873452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.873452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.874756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.877863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.915271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 994/1990] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:46 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:46.917401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.924377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:46.929871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:46.948590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663807f-aec0-47ce-98e7-168948f3ffe5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.955175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.955977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.956367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.956770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.957572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.960700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.961595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b299f3-9e0c-4497-a907-6e7e21119651 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:46.975650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:46.976210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 995/1991] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:46.976354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:46.976584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:46.976859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] PATH_INFO: `/v3/users/e058588749e744b5b3abd457aba29690` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:46.979984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e058588749e744b5b3abd457aba29690)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:46.980979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:46.981976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:46.995423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfbb44-e923-495c-bc9e-0b2854c9c4c5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.001604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.002717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.003228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.003773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.004712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.007188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.032795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 996/1992] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:47.038771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.050801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a1fe4-f284-4244-9026-ffd71b5ff976 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.078937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686590d-d8f9-41f4-8431-1df5520b50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.080540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686590d-d8f9-41f4-8431-1df5520b50e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.080925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686590d-d8f9-41f4-8431-1df5520b50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.081547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686590d-d8f9-41f4-8431-1df5520b50e2 admin admin] PATH_INFO: `/v3/projects/1c1f3391de1b42abb5065de8df63190f/users/ddad5c3fbbc242c082d807e9e4fdd090/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.120849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e058588749e744b5b3abd457aba29690'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.129488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686590d-d8f9-41f4-8431-1df5520b50e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1f3391de1b42abb5065de8df63190f, user_id=ddad5c3fbbc242c082d807e9e4fdd090, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.132757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686590d-d8f9-41f4-8431-1df5520b50e2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.170033 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e058588749e744b5b3abd457aba29690'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.172906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e058588749e744b5b3abd457aba29690'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.183192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 997/1993] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:47 2022] PUT /identity/v3/projects/1c1f3391de1b42abb5065de8df63190f/users/ddad5c3fbbc242c082d807e9e4fdd090/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:47.184277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.188704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.188704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.191751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e058588749e744b5b3abd457aba29690'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.216690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e058588749e744b5b3abd457aba29690'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.249877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 997/1994] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:46 2022] DELETE /identity/v3/users/e058588749e744b5b3abd457aba29690 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:47.275623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] MFA Rules not processed for user `ddad5c3fbbc242c082d807e9e4fdd090`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:47.277347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:47.426067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 998/1995] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:47.429643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.431242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:47.516856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73738c3f-fcd2-4196-9803-cc5c6988296e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.523406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.524145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.524732 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.525303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.526128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.530895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.543898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.545528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:47.572407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 998/1996] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:47 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:47.576092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.576218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e03109-b50e-4738-a4a1-620416f103f6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.670211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:47.672716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.673759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.674184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.674301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ed2ed-b52f-40cc-9684-f8b8fb6cad73 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.674711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] PATH_INFO: `/v3/projects/577d7e2e2148410ab8b8a98282053b64` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.679972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=577d7e2e2148410ab8b8a98282053b64)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.681681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.682429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.682836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.683122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.684109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.686362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.686515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.705697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:47.727087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 999/1997] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:47 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:47.729035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.745919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549da20-4956-48fc-a197-a50a6bbe0a23 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.752058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.752919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.753207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.753481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.754289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.756815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.776936 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1000/1998] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:47.777233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577d7e2e2148410ab8b8a98282053b64', 'request_id': 'req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.778492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.789374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577d7e2e2148410ab8b8a98282053b64', 'request_id': 'req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.792824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddf7c-bfc6-4d59-9e06-001c2aa66c21 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:47.797276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577d7e2e2148410ab8b8a98282053b64', 'request_id': 'req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.825385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] The token cache is being invalidate because project 577d7e2e2148410ab8b8a98282053b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:47.825756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.826420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-24d712e8-a3b7-46d7-bcb4-862208a5fcdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:47.830389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 999/1999] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:47 2022] DELETE /identity/v3/projects/577d7e2e2148410ab8b8a98282053b64 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:47.835427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad6db-6cab-4715-91f2-0425534d12c2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.835991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad6db-6cab-4715-91f2-0425534d12c2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.836549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad6db-6cab-4715-91f2-0425534d12c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.859871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-617ad6db-6cab-4715-91f2-0425534d12c2 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:47.861505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-617ad6db-6cab-4715-91f2-0425534d12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:47.882787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:47.883459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.883734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.884145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] PATH_INFO: `/v3/projects/f615b1bbd46240909fc8f7f6f630a34c/users/d4a4ddcf0d304167ad32aa433e268e9f/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.903143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f615b1bbd46240909fc8f7f6f630a34c, user_id=d4a4ddcf0d304167ad32aa433e268e9f, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:47.906419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:47.928641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1001/2000] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:47 2022] PUT /identity/v3/projects/f615b1bbd46240909fc8f7f6f630a34c/users/d4a4ddcf0d304167ad32aa433e268e9f/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:47.930168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:47.931968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:47.952477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1000/2001] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:47.958634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:47.959222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:47.959702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:47.983583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:47.985443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:48.010788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6e0c-c32d-4a0c-a667-985ea490824d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.017290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.018065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.018352 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.018628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.019337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.021708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.037043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1002/2002] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:48.041477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.054453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7181ee-ffca-4da8-83f9-b730da086b71 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.059827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81459-6671-4d50-87a2-d3f218c02970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.060505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81459-6671-4d50-87a2-d3f218c02970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.060787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81459-6671-4d50-87a2-d3f218c02970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.061062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81459-6671-4d50-87a2-d3f218c02970 admin admin] PATH_INFO: `/v3/projects/f615b1bbd46240909fc8f7f6f630a34c/users/d4a4ddcf0d304167ad32aa433e268e9f/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.062345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1001/2003] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:48.066983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81459-6671-4d50-87a2-d3f218c02970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f615b1bbd46240909fc8f7f6f630a34c, user_id=d4a4ddcf0d304167ad32aa433e268e9f, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.068367 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.069973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81459-6671-4d50-87a2-d3f218c02970 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.079057 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee20d10-8722-47b6-b821-f8bc8f8f9cc9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.091303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1003/2004] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:48 2022] PUT /identity/v3/projects/f615b1bbd46240909fc8f7f6f630a34c/users/d4a4ddcf0d304167ad32aa433e268e9f/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:48.101939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.102346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.102734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.143313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:48.143910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] MFA Rules not processed for user `d4a4ddcf0d304167ad32aa433e268e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:48.144676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:48.184009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:48.200891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.201897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.202240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.202639 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.204871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:48.205277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.207512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.225520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1002/2005] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:06:48.226766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.238577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489488-aa50-4fff-9b25-2884224729b4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.243535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.244456 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.244919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.245288 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.246062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.249098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.257653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1004/2006] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:48.275828 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.278076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:48.282873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1003/2007] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:48.287889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.387229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ffa1-3583-4d47-9020-c2c4037ac7b1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.394493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeac75-adc7-49ef-a175-8ce3b7d60fe0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.400817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.401445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.401866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.401986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.402615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.404585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.441785 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1004/2008] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:48.445863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.456655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314560-0dc3-4210-b1f0-3ccaea1b5934 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.464006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.464852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.465386 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.465717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.466490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.468734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.482337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1005/2009] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:48.488113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.491298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.492135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.493158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.494699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.501621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830923-9f7b-4e2a-a80d-13f4457266d4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.508507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.509132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.509413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.509688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.510339 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.512642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.528178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1006/2010] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:48.531846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.547071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9776e4-83e9-478e-be06-cbe81bc20da5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.555083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1558b-370c-493f-8db7-392340f7d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.568358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1558b-370c-493f-8db7-392340f7d450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.568358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1558b-370c-493f-8db7-392340f7d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.568358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1558b-370c-493f-8db7-392340f7d450 admin admin] PATH_INFO: `/v3/projects/4e4d444803454ac7b0132e8156c3c077/users/46a1179d3d2d4c8aaade32657525edbd/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.586723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1558b-370c-493f-8db7-392340f7d450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4d444803454ac7b0132e8156c3c077, user_id=46a1179d3d2d4c8aaade32657525edbd, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.590106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1558b-370c-493f-8db7-392340f7d450 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.605091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.608184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.620382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1007/2011] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:48 2022] PUT /identity/v3/projects/4e4d444803454ac7b0132e8156c3c077/users/46a1179d3d2d4c8aaade32657525edbd/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:48.623992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.624364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.624721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.634788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1005/2012] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:48.663837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] MFA Rules not processed for user `46a1179d3d2d4c8aaade32657525edbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:48.665254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:48.717424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.719921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:48.737780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b6f5f-07df-4d6c-b1c7-cf7d62c7f09a service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.757661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1008/2013] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:48.761568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.792915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:48.831006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.831950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.832371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.832759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] PATH_INFO: `/v3/users/ddad5c3fbbc242c082d807e9e4fdd090` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.834641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddad5c3fbbc242c082d807e9e4fdd090)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.837321 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.888251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b45027-13b1-4960-b2ad-df84f02a2000 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:48.893659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:48.894155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.894506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.894851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.896260 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:48.896632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddad5c3fbbc242c082d807e9e4fdd090'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:48.898298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:48.918681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddad5c3fbbc242c082d807e9e4fdd090'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:48.919424 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddad5c3fbbc242c082d807e9e4fdd090'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:48.929516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddad5c3fbbc242c082d807e9e4fdd090'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:48.938821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1009/2014] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:48.943890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:48.944041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c07c8a66-f931-4f61-9b00-a58f271cd03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddad5c3fbbc242c082d807e9e4fdd090'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:48.946208 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:48.954062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1006/2015] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:48 2022] DELETE /identity/v3/users/ddad5c3fbbc242c082d807e9e4fdd090 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:48.955587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:48.956847 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:48.957210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:48.980978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:48.982957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:49.041410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee8daa-f023-4edc-8a6f-52d418dfd0e4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.061794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1007/2016] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:49.073047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.074548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:49.131018 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.131712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.132053 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.132490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.133189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.136364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.166094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1010/2017] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:48 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:49.167701 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.171092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f0575-59ff-4e9e-8878-c81293e595e5 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.174789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:49.177384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.178285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.178568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.178960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.180054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22cd13-0988-4584-b1dd-86de8c4c3dad admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.186503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.187236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.187651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.188030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.188795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.190503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.191166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:49.198513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.201744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.205516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1011/2018] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:49.209596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.215300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1008/2019] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:49.221659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc58e3e-e3d8-4752-a774-43a69f5c8a0d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.227667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7294b-4808-4895-923c-65a5d5a024ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.228450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7294b-4808-4895-923c-65a5d5a024ec admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.228800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7294b-4808-4895-923c-65a5d5a024ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.229149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7294b-4808-4895-923c-65a5d5a024ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.229869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7294b-4808-4895-923c-65a5d5a024ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.231530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7294b-4808-4895-923c-65a5d5a024ec admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.248798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1012/2020] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:49.253049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.268090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd4328-e2ca-4f24-89a7-72007d89ce9c service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.279040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.279851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.280232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.280640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] PATH_INFO: `/v3/projects/db06674043194fb593529023698317f8/users/25bc5c9a831c499b94e4ee1c5bf109bb/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.299274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db06674043194fb593529023698317f8, user_id=25bc5c9a831c499b94e4ee1c5bf109bb, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.302782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.330273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1009/2021] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:49 2022] PUT /identity/v3/projects/db06674043194fb593529023698317f8/users/25bc5c9a831c499b94e4ee1c5bf109bb/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:49.340349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.340636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.340912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.403833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] MFA Rules not processed for user `25bc5c9a831c499b94e4ee1c5bf109bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:49.405430 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:49.543253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1013/2022] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:49.547233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.686812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27797432-25cc-4e9b-a5b6-c61cc2e13af0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.695914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.696796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.698128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.698128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.698128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.700518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.769207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1010/2023] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:49 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:49.771118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.792847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b788e-d3ca-47e5-85e6-d4c6c1dd9c94 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:49.852790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:49.854759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:49.941447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:49.942354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:49.943671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:49.944103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:49.944972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:49.947711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:49.996965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9351-1c6e-46ba-b750-093ce9dd3c5a admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.004259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.005817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.006229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.006751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] PATH_INFO: `/v3/projects/1c1f3391de1b42abb5065de8df63190f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.008322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1f3391de1b42abb5065de8df63190f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.010706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.017650 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1014/2024] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:49 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:50.022389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.047184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a54a6b-889c-471b-8ef3-9a86cadea287 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.054304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.055005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.055352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.056301 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.057400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.059218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.076076 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1015/2025] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:50.081310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.097268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1f3391de1b42abb5065de8df63190f', 'request_id': 'req-ca0f44a3-50e0-439f-bb69-511b637541a5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.120141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1f3391de1b42abb5065de8df63190f', 'request_id': 'req-ca0f44a3-50e0-439f-bb69-511b637541a5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.125228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:50.126072 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cb662-3799-4a1d-ac01-3f5ae702ae19 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.157241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1f3391de1b42abb5065de8df63190f', 'request_id': 'req-ca0f44a3-50e0-439f-bb69-511b637541a5'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.175701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] The token cache is being invalidate because project 1c1f3391de1b42abb5065de8df63190f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:50.176537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.177411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.179163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1011/2026] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:49 2022] DELETE /identity/v3/projects/1c1f3391de1b42abb5065de8df63190f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:50.183860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.185992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:50.199428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:50.213383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.214190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.214554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.214918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] PATH_INFO: `/v3/projects/2f635832f8bf499fab4141e73760360b/users/67634b14d09941baa7778ee129c39910/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.236390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f635832f8bf499fab4141e73760360b, user_id=67634b14d09941baa7778ee129c39910, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.245199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.268389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1016/2027] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:50 2022] PUT /identity/v3/projects/2f635832f8bf499fab4141e73760360b/users/67634b14d09941baa7778ee129c39910/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:50.271168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.273051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:50.287217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f44a3-50e0-439f-bb69-511b637541a5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.361194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0896751-d07c-420c-bc65-270d1508c347 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.368568 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.369245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.369375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.369618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.370033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.370254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.370643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.370887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.371092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] PATH_INFO: `/v3/users/d4a4ddcf0d304167ad32aa433e268e9f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.372410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a4ddcf0d304167ad32aa433e268e9f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.372989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.374539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.387987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1017/2028] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:50.392281 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.406166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ffb8-08d1-4be7-8e28-b956691076c8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.415483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c05c-014b-4547-85ea-223567b3f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.416431 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c05c-014b-4547-85ea-223567b3f39f admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.418671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c05c-014b-4547-85ea-223567b3f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.419858 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c05c-014b-4547-85ea-223567b3f39f admin admin] PATH_INFO: `/v3/projects/2f635832f8bf499fab4141e73760360b/users/67634b14d09941baa7778ee129c39910/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.422489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c05c-014b-4547-85ea-223567b3f39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f635832f8bf499fab4141e73760360b, user_id=67634b14d09941baa7778ee129c39910, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.425310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c05c-014b-4547-85ea-223567b3f39f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.440376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1018/2029] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:50 2022] PUT /identity/v3/projects/2f635832f8bf499fab4141e73760360b/users/67634b14d09941baa7778ee129c39910/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:50.452538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.452893 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.453269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.456250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a4ddcf0d304167ad32aa433e268e9f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.474213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a4ddcf0d304167ad32aa433e268e9f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.475073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a4ddcf0d304167ad32aa433e268e9f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.485056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a4ddcf0d304167ad32aa433e268e9f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.497217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] MFA Rules not processed for user `67634b14d09941baa7778ee129c39910`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:50.498748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a4ddcf0d304167ad32aa433e268e9f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:50.499458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:50.507598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1012/2030] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:50 2022] DELETE /identity/v3/users/d4a4ddcf0d304167ad32aa433e268e9f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:50.624697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1019/2031] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:50.633270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.636540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:50.653364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:50.721408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e33a-057a-4257-87bd-eaf2596a3aaa admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:50.732022 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:50.732884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:50.733336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:50.733726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:50.735759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:50.872273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:50.873867 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b29c38-1b91-4a1e-b052-07d4a9464810 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:50.912062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1013/2032] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:50.937490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:50.940249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:51.048528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:51.081628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83fa2-d194-482c-9aa4-d7c854e529b1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.189927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.191058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.191446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.193937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] PATH_INFO: `/v3/projects/f615b1bbd46240909fc8f7f6f630a34c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.193937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f615b1bbd46240909fc8f7f6f630a34c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:51.196090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:51.334542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f615b1bbd46240909fc8f7f6f630a34c', 'request_id': 'req-38668966-5582-4a32-bf85-21a8d357f0e8'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:51.415932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f615b1bbd46240909fc8f7f6f630a34c', 'request_id': 'req-38668966-5582-4a32-bf85-21a8d357f0e8'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:51.432977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f615b1bbd46240909fc8f7f6f630a34c', 'request_id': 'req-38668966-5582-4a32-bf85-21a8d357f0e8'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:51.481252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] The token cache is being invalidate because project f615b1bbd46240909fc8f7f6f630a34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:51.481822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:51.483934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-38668966-5582-4a32-bf85-21a8d357f0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:51.487734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1020/2033] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:50 2022] DELETE /identity/v3/projects/f615b1bbd46240909fc8f7f6f630a34c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:51.495040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.495606 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.496078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.553050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:51.554492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:51.646865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1014/2034] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:51.655884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.656179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.656545 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.683563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:51.684946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:51.699065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1021/2035] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:51.700202 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:51.710919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356a83-6424-4b52-893b-f2f60e55c9c2 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.715621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.716377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.716593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.716990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.717652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:51.717952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:51.719568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:51.736220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1015/2036] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:51.737763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:51.748744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4b2bb-6c64-4d30-9fc5-a0e4f971e6b8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.754000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.754686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.756198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.756198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.756757 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:51.758753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:51.793618 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1022/2037] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:51 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:51.794838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:51.806593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825c4d-eb49-41e3-9122-e5542996d338 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.862474 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:51.871335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.872069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.872590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.872972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.873705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:51.875768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:51.897477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1016/2038] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:51 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:51.901706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:51.912111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4670-4710-4dab-9113-08c61029bc63 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.917159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.917774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.918048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.918325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.919050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:51.920723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:51.932254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1023/2039] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:51.937123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:51.948322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ec44-e79f-45c5-96cf-51ca5e865b66 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.954394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62adf5-b2bc-43a0-b7c3-5b9479db5ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.955025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62adf5-b2bc-43a0-b7c3-5b9479db5ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.955379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62adf5-b2bc-43a0-b7c3-5b9479db5ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.955657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62adf5-b2bc-43a0-b7c3-5b9479db5ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:51.956293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62adf5-b2bc-43a0-b7c3-5b9479db5ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:51.958038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62adf5-b2bc-43a0-b7c3-5b9479db5ed1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:51.974186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1017/2040] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:51.978236 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:51.991352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1b7aa-0289-4bc1-86cc-2586bf28c099 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:51.996799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:51.997459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:51.997739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:51.998015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] PATH_INFO: `/v3/projects/c3bf7a90544a413daec8c3c79856cda3/users/9490fedb19d34aa9a663adc28a7f1785/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.015660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf7a90544a413daec8c3c79856cda3, user_id=9490fedb19d34aa9a663adc28a7f1785, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.018932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.033375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1024/2041] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:51 2022] PUT /identity/v3/projects/c3bf7a90544a413daec8c3c79856cda3/users/9490fedb19d34aa9a663adc28a7f1785/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:52.043874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.044736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.045015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.077297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] MFA Rules not processed for user `9490fedb19d34aa9a663adc28a7f1785`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:52.078663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:52.166411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1018/2042] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:52.168036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:52.194598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:52.256290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306a71-74e7-4442-89c0-ec871566c000 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:52.264537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:52.265510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.265968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.266335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.267447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.270000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.312604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1025/2043] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:52 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:52.313797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:52.324974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda236c-7044-4882-8505-fa83e9ad91f3 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:52.413908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:52.414673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.414964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.415234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.415947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.419374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.454384 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1019/2044] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:52 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:52.458727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:52.471123 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8f81c-4ba6-4e99-bcb7-475be5b6a65f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:52.478767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:52.479689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.480118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.480593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.481460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.483324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.496742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1026/2045] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:52.501038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:52.515060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0230a4-2b26-41f5-a381-4be6b971c523 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:52.521343 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:52.522311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.522907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.523313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] PATH_INFO: `/v3/projects/47151e0507f94491a18f97598828112d/users/8d9013ebc4574843acbd4ec72d4268e7/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.544896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47151e0507f94491a18f97598828112d, user_id=8d9013ebc4574843acbd4ec72d4268e7, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.551492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.588175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1020/2046] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:52 2022] PUT /identity/v3/projects/47151e0507f94491a18f97598828112d/users/8d9013ebc4574843acbd4ec72d4268e7/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:52.604478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:52.618210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfa530-b203-487c-832e-a67067924c94 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:52.706920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b58a53-c3e1-4c24-aaf2-c3077549413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:52.707849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58a53-c3e1-4c24-aaf2-c3077549413f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.708781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58a53-c3e1-4c24-aaf2-c3077549413f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.709150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58a53-c3e1-4c24-aaf2-c3077549413f admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.709896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b58a53-c3e1-4c24-aaf2-c3077549413f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.711596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b58a53-c3e1-4c24-aaf2-c3077549413f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.725228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1027/2047] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:06:52.729353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:52.742899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d415f-7185-4b95-a445-65cc1bf8f095 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:52.748486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:52.749284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.749668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.752511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] PATH_INFO: `/v3/projects/47151e0507f94491a18f97598828112d/users/8d9013ebc4574843acbd4ec72d4268e7/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.754661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47151e0507f94491a18f97598828112d, user_id=8d9013ebc4574843acbd4ec72d4268e7, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:52.758197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:52.771551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1021/2048] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:52 2022] PUT /identity/v3/projects/47151e0507f94491a18f97598828112d/users/8d9013ebc4574843acbd4ec72d4268e7/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:52.784032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:52.784461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:52.784834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:52.843282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] MFA Rules not processed for user `8d9013ebc4574843acbd4ec72d4268e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:52.844698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:53.038996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1028/2049] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:53.044899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:53.046666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:53.053223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:53.055140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:53.071386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:53.071740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:53.139675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e589f-fdb9-42b7-b155-ffcde29aa548 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:53.146077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:53.146928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:53.147213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:53.147486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:53.164529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:53.166498 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:53.168944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882432-3a07-46e1-af2b-3327a11a7d2f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:53.174505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:53.175770 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:53.176515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:53.177122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:53.179193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:53.180182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1029/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:06:53.296698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:53.299009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:53.322003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1022/2051] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:53.326827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:53.338748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5dc4d-0fd6-4485-b5ef-f426170ede66 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:53.344196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2fef1-d73a-4f2a-b35c-c5179c0e7714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:53.345034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2fef1-d73a-4f2a-b35c-c5179c0e7714 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:53.345470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2fef1-d73a-4f2a-b35c-c5179c0e7714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:53.345754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2fef1-d73a-4f2a-b35c-c5179c0e7714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:53.424067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2fef1-d73a-4f2a-b35c-c5179c0e7714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:53.425894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2fef1-d73a-4f2a-b35c-c5179c0e7714 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:53.437262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1030/2052] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:54.095791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:54.110293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee490d-a3da-4a50-b54b-ba1a7a571539 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:54.123736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:54.125468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:54.125765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:54.126583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:54.129758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:54.284283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:54.286073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:54.297600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1023/2053] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:57.593115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:57.593641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:57.593733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:57.613369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:57.614692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:57.668853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1031/2054] 10.222.0.49 () {58 vars in 967 bytes} [Wed Oct 26 11:06:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:57.681308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:57.682838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:57.704229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:57.705705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:57.759797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db3f2-7db6-4f05-9517-7148c0fe192e service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:57.765317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429e61-c21f-43d9-a273-88025f3b828f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:57.766160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429e61-c21f-43d9-a273-88025f3b828f service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:57.766514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429e61-c21f-43d9-a273-88025f3b828f service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:57.766859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429e61-c21f-43d9-a273-88025f3b828f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:57.773452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:57.779189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429e61-c21f-43d9-a273-88025f3b828f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:57.781239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429e61-c21f-43d9-a273-88025f3b828f service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:57.782735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:57.786943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad56cfe-2019-4afe-9531-269a90d0e138 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:57.791678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1024/2055] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:06:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:06:57.792035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:57.792713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:57.793028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:57.793415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] PATH_INFO: `/v3/users/1912adc7cf454dc4824969d5ec1b5f35` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:57.797115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1912adc7cf454dc4824969d5ec1b5f35)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:57.799176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:57.862575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1912adc7cf454dc4824969d5ec1b5f35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:57.877329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1912adc7cf454dc4824969d5ec1b5f35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:57.878444 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1912adc7cf454dc4824969d5ec1b5f35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:57.887447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1912adc7cf454dc4824969d5ec1b5f35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:57.898550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1912adc7cf454dc4824969d5ec1b5f35'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:57.905960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1032/2056] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:57 2022] DELETE /identity/v3/users/1912adc7cf454dc4824969d5ec1b5f35 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:57.911234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:57.911759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:57.912146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:57.933953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:57.935166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.001860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1025/2057] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:58.012546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.013973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.077387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d12a1-000a-482d-936b-8b4b60e7e4a7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.081290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.081920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.082194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.082460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.092774 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.094321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.105551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1033/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:58.322359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.323928 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.337705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5accd65-b37b-41e1-9c74-605f9fe18f4a None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.342223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.342850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.343128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.343402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] PATH_INFO: `/v3/users/46a1179d3d2d4c8aaade32657525edbd` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.344570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a1179d3d2d4c8aaade32657525edbd)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.346737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.405187 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a1179d3d2d4c8aaade32657525edbd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.420705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.422679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.426070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a1179d3d2d4c8aaade32657525edbd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.427347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a1179d3d2d4c8aaade32657525edbd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.438800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a1179d3d2d4c8aaade32657525edbd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.439341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8a2a-c144-4f49-ba6e-3df8fdc9196e service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.447872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.449056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.449056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.449056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] PATH_INFO: `/v3/projects/827c1d25b7884104823d0b8b28fea929` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.450295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=827c1d25b7884104823d0b8b28fea929)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.452399 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.452875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fa75e549-3f07-4f50-9de9-1756b2ce84be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a1179d3d2d4c8aaade32657525edbd'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.467347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1026/2059] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:58 2022] DELETE /identity/v3/users/46a1179d3d2d4c8aaade32657525edbd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:58.477838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.478447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.478759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.510868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:58.512374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.512488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827c1d25b7884104823d0b8b28fea929', 'request_id': 'req-a4329d14-dbef-47ee-abec-365eee3eb7aa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.521302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827c1d25b7884104823d0b8b28fea929', 'request_id': 'req-a4329d14-dbef-47ee-abec-365eee3eb7aa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.528097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827c1d25b7884104823d0b8b28fea929', 'request_id': 'req-a4329d14-dbef-47ee-abec-365eee3eb7aa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.541552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] The token cache is being invalidate because project 827c1d25b7884104823d0b8b28fea929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:58.541834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.542831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4329d14-dbef-47ee-abec-365eee3eb7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.544321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1034/2060] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:58 2022] DELETE /identity/v3/projects/827c1d25b7884104823d0b8b28fea929 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:58.549338 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.549632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.549920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.559584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:58.576237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:58.578098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.593035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1027/2061] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:58.601977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.603799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.616177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a766314-cd9d-4872-83c9-c0037fe0ee58 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.621713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.622349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.622627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.622899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] PATH_INFO: `/v3/users/9490fedb19d34aa9a663adc28a7f1785` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.624250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9490fedb19d34aa9a663adc28a7f1785)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.626231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.631368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:58.660094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1035/2062] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:06:58.662311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.663624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.686613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9490fedb19d34aa9a663adc28a7f1785'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.701074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9490fedb19d34aa9a663adc28a7f1785'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.701819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9490fedb19d34aa9a663adc28a7f1785'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.711842 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9490fedb19d34aa9a663adc28a7f1785'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.720039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-430c274e-6c82-47ba-a7e3-04f593c31893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9490fedb19d34aa9a663adc28a7f1785'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:58.728876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752047b7-bfae-4b32-8566-00e7ae96f5f7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.729753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1028/2063] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:58 2022] DELETE /identity/v3/users/9490fedb19d34aa9a663adc28a7f1785 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:58.732440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde3d92-70e8-4ef1-b055-29e120b286aa None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.732440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde3d92-70e8-4ef1-b055-29e120b286aa None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.732440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde3d92-70e8-4ef1-b055-29e120b286aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.764534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ffde3d92-70e8-4ef1-b055-29e120b286aa None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:58.764534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ffde3d92-70e8-4ef1-b055-29e120b286aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.789460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.790098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.790378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.790645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.792384 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.821550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1029/2064] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:58.822860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.823170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.823440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.842156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:58.843353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.851402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1030/2065] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:58.852219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.860636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.861913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb86e0-d4f1-4465-a691-1d077ffdfce1 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.862348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.866516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.867105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.867379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.867645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.868284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:06:58.868611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.870171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.872248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1036/2066] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:58.873082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.874485 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:58.882969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1031/2067] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:06:58.885113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe53b7-ea9a-42ad-bad8-bb8fe825065d service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.887394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.889136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.889735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.890042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.890315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.898303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4678a4e-7271-4812-97b9-256b00e683ee admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:58.899952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:58.903263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.904831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:58.905785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:58.905898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.905996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:58.905996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:58.906562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:58.908463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:58.917040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1037/2068] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:06:58.938551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1032/2069] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:06:58.942993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:58.959914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81516c6c-4a35-42fa-95b9-593d46a44af2 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.065640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.066246 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.066521 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.066790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.067973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.069912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.096243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1038/2070] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:06:58 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:06:59.097697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.112093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aaa53-076d-4357-b2dc-52b1aacbd3e4 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.118126 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.118337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.118612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.118875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.119508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.121115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.132565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1033/2071] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:59.143569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.160302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb9dd-e3a3-4319-9795-2d7e07b86e51 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.165628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cd656-573e-4845-8a1b-d7b2e85f7109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.165857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cd656-573e-4845-8a1b-d7b2e85f7109 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.166145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cd656-573e-4845-8a1b-d7b2e85f7109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.166399 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cd656-573e-4845-8a1b-d7b2e85f7109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.167214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cd656-573e-4845-8a1b-d7b2e85f7109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.169372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cd656-573e-4845-8a1b-d7b2e85f7109 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.180942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1039/2072] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:06:59.185233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.197442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6acf-80ad-4358-a476-edfccb2cd7bb admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.206143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.207200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.207314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.207581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] PATH_INFO: `/v3/projects/bab30a768d6f4d4b955bc1b135bee84c/users/06f2b753703942a9a770249abcdae36f/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.230706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab30a768d6f4d4b955bc1b135bee84c, user_id=06f2b753703942a9a770249abcdae36f, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.233406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.257444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1034/2073] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:06:59 2022] PUT /identity/v3/projects/bab30a768d6f4d4b955bc1b135bee84c/users/06f2b753703942a9a770249abcdae36f/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:59.271345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.271452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.271851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.300912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:06:59.302220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.356085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.358870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.366346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:59.390049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1040/2074] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:06:59.406114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.409971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.500263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e685a-2322-4ec6-9e9e-042f451822ac admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.512623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.513651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.514145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.514903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] PATH_INFO: `/v3/projects/4e4d444803454ac7b0132e8156c3c077` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.516967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4d444803454ac7b0132e8156c3c077)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.519429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.539665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb48d-479b-42d4-9e85-769df3f310ed None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.544450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.545174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.545477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.545746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.564261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.565812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.579867 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4d444803454ac7b0132e8156c3c077', 'request_id': 'req-238f8328-9133-4920-81e3-caf13611c9f1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.580511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1041/2075] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:06:59.583358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.585499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.590582 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4d444803454ac7b0132e8156c3c077', 'request_id': 'req-238f8328-9133-4920-81e3-caf13611c9f1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.601562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4d444803454ac7b0132e8156c3c077', 'request_id': 'req-238f8328-9133-4920-81e3-caf13611c9f1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.608387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c49bc7-671c-4cec-b50a-78959944be2c service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.622953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] The token cache is being invalidate because project 4e4d444803454ac7b0132e8156c3c077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:59.623304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.624631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.626439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:59.626564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1035/2076] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:59 2022] DELETE /identity/v3/projects/4e4d444803454ac7b0132e8156c3c077 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:59.632242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.634064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.695153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.697952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.699385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.699860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] PATH_INFO: `/v3/projects/c3bf7a90544a413daec8c3c79856cda3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.704318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bf7a90544a413daec8c3c79856cda3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.710437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.720260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8328-9133-4920-81e3-caf13611c9f1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:06:59.730632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:06:59.731274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:06:59.731576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:06:59.731844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] PATH_INFO: `/v3/users/25bc5c9a831c499b94e4ee1c5bf109bb` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:06:59.736046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bc5c9a831c499b94e4ee1c5bf109bb)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:06:59.738283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:06:59.826856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bf7a90544a413daec8c3c79856cda3', 'request_id': 'req-90bd97e4-4115-440a-8502-f244a8981589'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.827812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:06:59.843344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bc5c9a831c499b94e4ee1c5bf109bb'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.848037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bf7a90544a413daec8c3c79856cda3', 'request_id': 'req-90bd97e4-4115-440a-8502-f244a8981589'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.858410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bf7a90544a413daec8c3c79856cda3', 'request_id': 'req-90bd97e4-4115-440a-8502-f244a8981589'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.869344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bc5c9a831c499b94e4ee1c5bf109bb'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.870844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bc5c9a831c499b94e4ee1c5bf109bb'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.878084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] The token cache is being invalidate because project c3bf7a90544a413daec8c3c79856cda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:06:59.878647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.880842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.882905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1042/2077] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:06:59 2022] DELETE /identity/v3/projects/c3bf7a90544a413daec8c3c79856cda3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:06:59.886059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bc5c9a831c499b94e4ee1c5bf109bb'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.887140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:06:59.890852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:06:59.911336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bc5c9a831c499b94e4ee1c5bf109bb'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:06:59.921147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1036/2078] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:59 2022] DELETE /identity/v3/users/25bc5c9a831c499b94e4ee1c5bf109bb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:06:59.982941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd97e4-4115-440a-8502-f244a8981589 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:00.045974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:00.055355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:00.055996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.056973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.057128 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] PATH_INFO: `/v3/users/8d9013ebc4574843acbd4ec72d4268e7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.058475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9013ebc4574843acbd4ec72d4268e7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:00.062855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:00.117432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9013ebc4574843acbd4ec72d4268e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.130860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9013ebc4574843acbd4ec72d4268e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.131550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9013ebc4574843acbd4ec72d4268e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.138879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9013ebc4574843acbd4ec72d4268e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.147363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9013ebc4574843acbd4ec72d4268e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.153463 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1043/2079] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:06:59 2022] DELETE /identity/v3/users/8d9013ebc4574843acbd4ec72d4268e7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:00.264576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:00.266363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:00.281808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3cb05-d236-44af-8230-1bfc3281b55e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:00.356575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:00.357391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.358205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.358490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] PATH_INFO: `/v3/users/6f217d8aa8fc4e9292195f8ad624eca2` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.360152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f217d8aa8fc4e9292195f8ad624eca2)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:00.362528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:00.435039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f217d8aa8fc4e9292195f8ad624eca2'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.453641 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f217d8aa8fc4e9292195f8ad624eca2'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.454750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f217d8aa8fc4e9292195f8ad624eca2'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.465258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f217d8aa8fc4e9292195f8ad624eca2'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.478021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f217d8aa8fc4e9292195f8ad624eca2'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.487116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1037/2080] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:00 2022] DELETE /identity/v3/users/6f217d8aa8fc4e9292195f8ad624eca2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:00.602473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:00.612182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:00.647950 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:00.650305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:00.670934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334958a-7425-4e98-9320-7a6d6ff27fb6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:00.741954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:00.779035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:00.779574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.779861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.780143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] PATH_INFO: `/v3/projects/47151e0507f94491a18f97598828112d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.781505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=47151e0507f94491a18f97598828112d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:00.783465 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:00.806212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d221-61c7-4c76-be63-f64e9912b2de admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:00.814065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:00.814927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.815274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.815891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] PATH_INFO: `/v3/projects/db06674043194fb593529023698317f8` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.817711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=db06674043194fb593529023698317f8)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:00.820558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:00.891251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47151e0507f94491a18f97598828112d', 'request_id': 'req-05a73aee-c79d-4671-9f74-48811b2e0ada'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.903482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47151e0507f94491a18f97598828112d', 'request_id': 'req-05a73aee-c79d-4671-9f74-48811b2e0ada'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.917694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db06674043194fb593529023698317f8', 'request_id': 'req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.919361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47151e0507f94491a18f97598828112d', 'request_id': 'req-05a73aee-c79d-4671-9f74-48811b2e0ada'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.933887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db06674043194fb593529023698317f8', 'request_id': 'req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.942658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] The token cache is being invalidate because project 47151e0507f94491a18f97598828112d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:00.943325 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.944292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-05a73aee-c79d-4671-9f74-48811b2e0ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.944432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db06674043194fb593529023698317f8', 'request_id': 'req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.950409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1044/2081] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:00 2022] DELETE /identity/v3/projects/47151e0507f94491a18f97598828112d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:00.950409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841f7e-4621-4339-b065-3db80b13e6b4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:00.950409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841f7e-4621-4339-b065-3db80b13e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:00.950409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841f7e-4621-4339-b065-3db80b13e6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:00.956767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] The token cache is being invalidate because project db06674043194fb593529023698317f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:00.958281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.958797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:00.960933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:00.961595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1038/2082] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:00 2022] DELETE /identity/v3/projects/db06674043194fb593529023698317f8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:00.964485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:00.966868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:00.986870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-98841f7e-4621-4339-b065-3db80b13e6b4 None None] MFA Rules not processed for user `06f2b753703942a9a770249abcdae36f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:00.988310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-98841f7e-4621-4339-b065-3db80b13e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.059715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c8177-8cba-4928-98fa-b85cfc18dcaf admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.068779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1045/2083] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:01.068972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.068972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.068972 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.069191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.069263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] PATH_INFO: `/v3/projects/1f99e504ed2b45e09426006be9d271a2` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.069345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.069345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.070872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f99e504ed2b45e09426006be9d271a2)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.073079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.089838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:01.091183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.100560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1046/2084] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:01.107100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.108155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.122920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757ee45-14c7-46f3-a923-a35d9367aa3f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.139349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f99e504ed2b45e09426006be9d271a2', 'request_id': 'req-be88ce6f-8127-45c5-b92d-1fad14c0137f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.151346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f99e504ed2b45e09426006be9d271a2', 'request_id': 'req-be88ce6f-8127-45c5-b92d-1fad14c0137f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.158338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:01.160575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f99e504ed2b45e09426006be9d271a2', 'request_id': 'req-be88ce6f-8127-45c5-b92d-1fad14c0137f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.176519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] The token cache is being invalidate because project 1f99e504ed2b45e09426006be9d271a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:01.177050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.177961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.180111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1039/2085] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:00 2022] DELETE /identity/v3/projects/1f99e504ed2b45e09426006be9d271a2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:01.181059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.182524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.201891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.202665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.203016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.203366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] PATH_INFO: `/v3/users/67634b14d09941baa7778ee129c39910` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.204661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67634b14d09941baa7778ee129c39910)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.206669 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.261908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88ce6f-8127-45c5-b92d-1fad14c0137f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.267402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.268014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.268303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.268622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.271155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.274747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67634b14d09941baa7778ee129c39910'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.298270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67634b14d09941baa7778ee129c39910'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.299088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67634b14d09941baa7778ee129c39910'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.308800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67634b14d09941baa7778ee129c39910'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.320144 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6cdb690a-8ed8-444f-94dd-2352cfc2ce7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67634b14d09941baa7778ee129c39910'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:01.329274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1047/2086] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:01 2022] DELETE /identity/v3/users/67634b14d09941baa7778ee129c39910 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:01.334737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.334922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.335213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.349310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.350525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:01.351773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f94d8-aa8d-4292-bba0-946b0e6bbfe6 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.361263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:01.363437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.363804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1040/2087] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:01.365725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c619d-13b7-4bdf-9c2e-25baf8a7655f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.366063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c619d-13b7-4bdf-9c2e-25baf8a7655f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.366689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c619d-13b7-4bdf-9c2e-25baf8a7655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.392820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-681c619d-13b7-4bdf-9c2e-25baf8a7655f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:01.394194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-681c619d-13b7-4bdf-9c2e-25baf8a7655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.512112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1048/2088] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:01.516624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.532531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9e7ef-e07b-4c30-b1c4-4890879a2a1c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.551561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1041/2089] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:01.555627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.555999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.556316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.557426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.558147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.558390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.558632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.559353 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:01.559547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.561193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.595978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1049/2090] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 26 11:07:01.596191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:01.596191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.596841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.611266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1042/2091] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:01.619046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5725219-7964-442e-b8e3-a2193cf88013 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.628271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.634960 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.635754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.636142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.636464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.637165 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.645940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.647107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de215d5-f8fc-45d4-a7c8-420535eae7f9 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.653138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.654280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.654789 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.655265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.656122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:01.656652 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.658764 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.678166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1043/2092] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:01.679104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.696423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aeeaf-e27d-4c86-9c23-e97cda70337d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.704166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.705860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.706481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.707481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.709262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.710370 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1050/2093] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:01.714888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.715190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.779309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1044/2094] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:01.783237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.799834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:01.837981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb7d23-2fd8-4a2b-8345-62a72c306341 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.934519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdae2-1283-4745-9d37-baaa2e78354e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.940853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.941611 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.941877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.942700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.943427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.945648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.960202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.960987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.961356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.961636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.962328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.964484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:01.970775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1045/2095] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:01.971623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.973608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:01.986150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6804d-2ffb-4b59-bd25-fb1709d1adeb admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:01.986346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1051/2096] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:01 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:07:01.990527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:01.992040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:01.992690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:01.992969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:01.993240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] PATH_INFO: `/v3/projects/2f635832f8bf499fab4141e73760360b` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:01.994586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f635832f8bf499fab4141e73760360b)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:01.996735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.001587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa003-a019-4514-9ef7-45af14d58f3b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.006880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.007511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.007827 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.008096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.008755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.010326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.012961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:02.022623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1052/2097] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:02.023499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.033349 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb27fc1-485b-4e19-a4a4-0aedc0f4c58d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.046743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f635832f8bf499fab4141e73760360b', 'request_id': 'req-bce8346e-89a5-43e6-841b-bbfb439870fc'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:02.054524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f635832f8bf499fab4141e73760360b', 'request_id': 'req-bce8346e-89a5-43e6-841b-bbfb439870fc'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:02.060989 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f635832f8bf499fab4141e73760360b', 'request_id': 'req-bce8346e-89a5-43e6-841b-bbfb439870fc'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:02.074537 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] The token cache is being invalidate because project 2f635832f8bf499fab4141e73760360b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:02.074829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:02.075557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:02.077084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1046/2098] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:01 2022] DELETE /identity/v3/projects/2f635832f8bf499fab4141e73760360b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:02.077844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.079280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.092685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2ea32-77ec-4667-88a0-7cfc9c38bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.093291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ea32-77ec-4667-88a0-7cfc9c38bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.093566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ea32-77ec-4667-88a0-7cfc9c38bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.093837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ea32-77ec-4667-88a0-7cfc9c38bc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.094623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2ea32-77ec-4667-88a0-7cfc9c38bc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.096323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2ea32-77ec-4667-88a0-7cfc9c38bc6f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.106631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1053/2099] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:02.107864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.108135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.108428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.129181 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:02.130970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.139614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1054/2100] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:02.145848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.145848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.153971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b23e1-e5d4-4df5-983f-a7ab5a950a55 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.159294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8be39-85e2-47cc-a421-b9b8ea3d84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.159936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8be39-85e2-47cc-a421-b9b8ea3d84c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.160217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8be39-85e2-47cc-a421-b9b8ea3d84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.160518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8be39-85e2-47cc-a421-b9b8ea3d84c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.161697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8be39-85e2-47cc-a421-b9b8ea3d84c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.163293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8be39-85e2-47cc-a421-b9b8ea3d84c0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.163405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8346e-89a5-43e6-841b-bbfb439870fc admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.168303 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.168942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.169219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.169487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.170118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.171716 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.173874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1055/2101] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:02.175094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.175374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.175645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.186416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1047/2102] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:02.187251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.196856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:02.198043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52597-0fc2-4537-8151-d6e8541ff817 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.198158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.202703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.203408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.203754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.204096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] PATH_INFO: `/v3/projects/89458a43ca734a8ebe3a54c028365840/users/21a2c95a637e40918944246c43742caf/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.205898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1056/2103] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:02.205898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.216302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9709d0a-bc6d-4145-aa41-b9cceb8ee557 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.220553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:02.220936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54854923-de8f-42f9-b7f7-f5fddc932dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.221596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54854923-de8f-42f9-b7f7-f5fddc932dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.221871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54854923-de8f-42f9-b7f7-f5fddc932dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.222106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54854923-de8f-42f9-b7f7-f5fddc932dca admin admin] PATH_INFO: `/v3/projects/f1d502242d05414eb550a11f6ae4b69f/users/2b744adf61a64188829e904ccec6052f/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.227518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89458a43ca734a8ebe3a54c028365840, user_id=21a2c95a637e40918944246c43742caf, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.230262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.240582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54854923-de8f-42f9-b7f7-f5fddc932dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d502242d05414eb550a11f6ae4b69f, user_id=2b744adf61a64188829e904ccec6052f, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.243355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54854923-de8f-42f9-b7f7-f5fddc932dca admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.247254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1048/2104] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:02 2022] PUT /identity/v3/projects/89458a43ca734a8ebe3a54c028365840/users/21a2c95a637e40918944246c43742caf/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:02.248252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.263380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1057/2105] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:02 2022] PUT /identity/v3/projects/f1d502242d05414eb550a11f6ae4b69f/users/2b744adf61a64188829e904ccec6052f/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:02.264859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72fa4-5096-478e-984e-fa37b384c609 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.265207 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72fa4-5096-478e-984e-fa37b384c609 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.265550 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72fa4-5096-478e-984e-fa37b384c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.297004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f3f72fa4-5096-478e-984e-fa37b384c609 None None] MFA Rules not processed for user `21a2c95a637e40918944246c43742caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:02.299749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f3f72fa4-5096-478e-984e-fa37b384c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.316871 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db99bfc-daa8-4506-bcba-6fce7025900c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.375166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1058/2106] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:02.376480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.376765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.377056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.383366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.384129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.384979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.385470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.386131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:02.386504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.388131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.405245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1049/2107] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:02.405245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.405809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] MFA Rules not processed for user `2b744adf61a64188829e904ccec6052f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:02.407025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.413910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6074f-7bf1-4b8c-a117-0424546bdcab admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.419583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.420170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.420496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.420769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.421387 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.423283 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.433523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:02.459096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1050/2108] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:02.459096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.494422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1059/2109] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:02.495398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.510583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499265-9ece-4f74-8936-431e74e7ebf9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.543396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c6fb8-c8fb-4dc9-9939-7821f6f26465 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.550023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.551055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.554080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.554607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.556185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.559646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.577699 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:02.595903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1051/2110] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:02.598122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.601369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.631269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.631902 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.632185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.632483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.633129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.635290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.689413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1060/2111] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:02.689413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.711020 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5eb25-87a7-456f-b1a6-0e1981bb041c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.715138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.715919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.716147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06fe9-2557-48a1-9c1c-8851d3622576 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.716664 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.717212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.800205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2a9de-4f38-4fa8-8a25-62bb052d3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.803143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2a9de-4f38-4fa8-8a25-62bb052d3f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.804156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2a9de-4f38-4fa8-8a25-62bb052d3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.805607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2a9de-4f38-4fa8-8a25-62bb052d3f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.805975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2a9de-4f38-4fa8-8a25-62bb052d3f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.809120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.810547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2a9de-4f38-4fa8-8a25-62bb052d3f4b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.812531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.824630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1052/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:02.825775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.839236 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7d600-96ed-42f9-9851-ca8af16f1729 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.844623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1061/2113] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:02.846653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.847380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.847771 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.848116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.849149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.850434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.850724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.851378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.853069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.874711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1053/2114] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:02.875752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.888927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66c66-8270-4030-803a-bc367d670457 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.891329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:02.894162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:02.920861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.921478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.924440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.924724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:02.925370 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:02.927659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:02.962395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1054/2115] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:02.965197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:02.978917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07ff5-2b7e-48bd-848b-d9935e2e7e43 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:02.983995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247769c-15df-44f2-9d86-35d2cf624233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:02.984681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247769c-15df-44f2-9d86-35d2cf624233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:02.984966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247769c-15df-44f2-9d86-35d2cf624233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:02.985257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247769c-15df-44f2-9d86-35d2cf624233 admin admin] PATH_INFO: `/v3/projects/3d8bc38c86e44e6c8a3c5a3f8d00cfcd/users/a4ee50b5bd2c4fe69862bc8197e61ccb/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.002822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247769c-15df-44f2-9d86-35d2cf624233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8bc38c86e44e6c8a3c5a3f8d00cfcd, user_id=a4ee50b5bd2c4fe69862bc8197e61ccb, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.005651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247769c-15df-44f2-9d86-35d2cf624233 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.016473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:03.039648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1055/2116] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:02 2022] PUT /identity/v3/projects/3d8bc38c86e44e6c8a3c5a3f8d00cfcd/users/a4ee50b5bd2c4fe69862bc8197e61ccb/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:03.049794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.053050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1062/2117] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:03.053932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.058917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.063061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.078527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec883-0bb6-40bc-9a13-4a17453136f3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:03.106976 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] MFA Rules not processed for user `06f2b753703942a9a770249abcdae36f`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:03.108507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:03.177767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1056/2118] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:03.179014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.193825 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:03.235148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:03.235779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.236102 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.236408 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.237385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.242189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.266505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1063/2119] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:03.266505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.268041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:03.280787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddb5c8-3d12-419e-af74-a5920f6c782f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:03.289795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:03.291553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.291981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.292346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.293154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.295276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.321905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1057/2120] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:03.321905 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.334123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf635fa-5985-430d-b11a-302ca4cedd6c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:03.346253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:03.347067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.347452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.347830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] PATH_INFO: `/v3/projects/3073e31c4f9f4e88a4843d282c5f289a/users/fd7dc257718a407ca0115039514e239b/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.376769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3073e31c4f9f4e88a4843d282c5f289a, user_id=fd7dc257718a407ca0115039514e239b, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.382054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.412760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1058/2121] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:03 2022] PUT /identity/v3/projects/3073e31c4f9f4e88a4843d282c5f289a/users/fd7dc257718a407ca0115039514e239b/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:03.414222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.434387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcdcc8-ea1d-4167-a95a-7c07d2585f73 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:03.513175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f97774-9e11-4c46-9b46-0793835d0812 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:03.518628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c10b26-a040-483d-95cd-1ad4290569a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:03.519525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10b26-a040-483d-95cd-1ad4290569a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.519949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10b26-a040-483d-95cd-1ad4290569a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.520813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10b26-a040-483d-95cd-1ad4290569a8 admin admin] PATH_INFO: `/v3/projects/3d8bc38c86e44e6c8a3c5a3f8d00cfcd/users/a4ee50b5bd2c4fe69862bc8197e61ccb/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.524468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c10b26-a040-483d-95cd-1ad4290569a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8bc38c86e44e6c8a3c5a3f8d00cfcd, user_id=a4ee50b5bd2c4fe69862bc8197e61ccb, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.527463 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c10b26-a040-483d-95cd-1ad4290569a8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.539035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:03.539945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1059/2122] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:03 2022] PUT /identity/v3/projects/3d8bc38c86e44e6c8a3c5a3f8d00cfcd/users/a4ee50b5bd2c4fe69862bc8197e61ccb/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:03.540457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.540748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.541026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.541375 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907446c-8f06-44af-8bca-3788f13fd5ba None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.541666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907446c-8f06-44af-8bca-3788f13fd5ba None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.542096 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907446c-8f06-44af-8bca-3788f13fd5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.562436 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a907446c-8f06-44af-8bca-3788f13fd5ba None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:03.563677 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a907446c-8f06-44af-8bca-3788f13fd5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:03.594856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:03.665683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1060/2123] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:03.667001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.667255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.667675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.671150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.672997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.682821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1064/2124] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:07:03.687148 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.688926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:03.708285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:03.728591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] MFA Rules not processed for user `a4ee50b5bd2c4fe69862bc8197e61ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:03.733834 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:03.816284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf06c5-60d9-49d6-a5fc-3f5eabc82f47 service swift] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:03.898017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1061/2125] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:03.914603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:03.935819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:03.937068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:03.937504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:03.937932 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:03.966930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:03.968946 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:03.984531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1065/2126] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:07:04.018152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a650-d46f-4c6e-8fbf-7bd05fd2a084 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:04.022687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ee019-475b-44b4-a9f8-d12436b0f32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:04.023815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ee019-475b-44b4-a9f8-d12436b0f32a service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:04.024263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ee019-475b-44b4-a9f8-d12436b0f32a service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:04.024938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ee019-475b-44b4-a9f8-d12436b0f32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:04.041731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ee019-475b-44b4-a9f8-d12436b0f32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:04.044533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ee019-475b-44b4-a9f8-d12436b0f32a service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:04.057277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1062/2127] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:04.820364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:04.853814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862f9c-c155-49a4-9a46-3de2aefcf020 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:04.864449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:04.865619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:04.866801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:04.867487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] PATH_INFO: `/v3/users/21a2c95a637e40918944246c43742caf` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:04.870425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a2c95a637e40918944246c43742caf)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:04.877240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:05.008582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a2c95a637e40918944246c43742caf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:05.044280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a2c95a637e40918944246c43742caf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:05.046839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a2c95a637e40918944246c43742caf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:05.063857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a2c95a637e40918944246c43742caf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:05.084824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a2c95a637e40918944246c43742caf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:05.088049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:05.093323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1066/2128] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:04 2022] DELETE /identity/v3/users/21a2c95a637e40918944246c43742caf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:05.097459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:05.097977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:05.098238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:05.130878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:05.132327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:05.258460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1063/2129] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:05.270653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:05.272614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:05.491389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d27e86-0d11-4f0d-aba7-29bc950cfe9a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:05.507723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:05.508424 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:05.508741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:05.509023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:05.525906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:05.528432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:05.562204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1067/2130] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:06.204356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:06.205952 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:06.235558 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20838f9-bb5e-4354-9f91-e6b98e2cb581 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:06.250233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:06.250896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:06.251665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:06.251665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] PATH_INFO: `/v3/projects/89458a43ca734a8ebe3a54c028365840` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:06.254783 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89458a43ca734a8ebe3a54c028365840)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:06.262122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:06.383941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:06.407123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89458a43ca734a8ebe3a54c028365840', 'request_id': 'req-eb5abe0c-0305-49cb-8f2e-b50559833523'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.417507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89458a43ca734a8ebe3a54c028365840', 'request_id': 'req-eb5abe0c-0305-49cb-8f2e-b50559833523'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.427581 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89458a43ca734a8ebe3a54c028365840', 'request_id': 'req-eb5abe0c-0305-49cb-8f2e-b50559833523'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.461728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] The token cache is being invalidate because project 89458a43ca734a8ebe3a54c028365840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:06.462854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.466642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.468690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1064/2131] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:06 2022] DELETE /identity/v3/projects/89458a43ca734a8ebe3a54c028365840 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:06.473586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:06.502801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee9b8-1434-4f8f-9dbc-06560092f95a service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:06.677382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:06.678050 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:06.692265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:06.692265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] PATH_INFO: `/v3/users/a4ee50b5bd2c4fe69862bc8197e61ccb` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:06.692265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ee50b5bd2c4fe69862bc8197e61ccb)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:06.697064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:06.829075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ee50b5bd2c4fe69862bc8197e61ccb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.859480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ee50b5bd2c4fe69862bc8197e61ccb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.860811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ee50b5bd2c4fe69862bc8197e61ccb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.875796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ee50b5bd2c4fe69862bc8197e61ccb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.890914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c89bb684-1270-4d96-8cc5-f5a580745f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ee50b5bd2c4fe69862bc8197e61ccb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:06.900583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1068/2132] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:06 2022] DELETE /identity/v3/users/a4ee50b5bd2c4fe69862bc8197e61ccb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:08.212943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:08.215331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:08.255060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5abe0c-0305-49cb-8f2e-b50559833523 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:08.433466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:08.435136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:08.435953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:08.436523 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] PATH_INFO: `/v3/projects/3d8bc38c86e44e6c8a3c5a3f8d00cfcd` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:08.438307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8bc38c86e44e6c8a3c5a3f8d00cfcd)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:08.444276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:08.603114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8bc38c86e44e6c8a3c5a3f8d00cfcd', 'request_id': 'req-61b708b2-a058-4639-b70e-4cf4a462074d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:08.633356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8bc38c86e44e6c8a3c5a3f8d00cfcd', 'request_id': 'req-61b708b2-a058-4639-b70e-4cf4a462074d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:08.646841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8bc38c86e44e6c8a3c5a3f8d00cfcd', 'request_id': 'req-61b708b2-a058-4639-b70e-4cf4a462074d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:08.666479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] The token cache is being invalidate because project 3d8bc38c86e44e6c8a3c5a3f8d00cfcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:08.667192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:08.668014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-61b708b2-a058-4639-b70e-4cf4a462074d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:08.670072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1065/2133] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:08 2022] DELETE /identity/v3/projects/3d8bc38c86e44e6c8a3c5a3f8d00cfcd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:08.674579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:08.675412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:08.676674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:08.730147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:08.732068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:08.756579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:08.843264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1069/2134] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:08.851406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:08.851687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:08.851962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:08.895122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:08.896183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:08.920405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1066/2135] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:08.924372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:08.939385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62663cb7-f50c-4d0d-86b8-34e71465159f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:08.953197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:08.954135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:08.954566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:08.955026 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:08.956769 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:08.957251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:08.963739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:09.005390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1070/2136] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:09.008723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:09.021759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e568-cb60-4834-9057-a38580b0e545 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:09.045101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:09.046142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:09.046296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:09.046576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:09.047217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:09.049706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:09.138518 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1067/2137] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:09 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:09.139570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:09.156863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4fcd-b8df-444c-8eac-a0e04bbade9c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:09.271644 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:09.272480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:09.272766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:09.275233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:09.277361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:09.285409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:09.355977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1071/2138] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:09 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:09.360271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:09.377626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889945ee-1a4b-4a56-8454-4869f3e33cdc admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:09.403485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:09.405722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:09.406156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:09.407912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:09.409556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:09.414293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:09.453940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:09.464746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1068/2139] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:09.467401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4a73-03b2-4b5e-b9fb-e286e9b25f5c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:09.483911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1318-b311-4454-819d-8a7134d99a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:09.485716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1318-b311-4454-819d-8a7134d99a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:09.486140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1318-b311-4454-819d-8a7134d99a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:09.486819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1318-b311-4454-819d-8a7134d99a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:09.487620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a1318-b311-4454-819d-8a7134d99a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:09.490354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a1318-b311-4454-819d-8a7134d99a33 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:09.523619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:09.534610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021f296-875b-4c07-89ec-16e05d703004 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:09.535127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1072/2140] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:09.549217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:09.552405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:09.552869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:09.553293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] PATH_INFO: `/v3/projects/9a2254fb03144287bd995bc11379a395/users/8348c56d8f094bdba5de1d8ead3ef79f/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:09.583271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:09.602381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2254fb03144287bd995bc11379a395, user_id=8348c56d8f094bdba5de1d8ead3ef79f, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:09.605517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:09.646883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1069/2141] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:09 2022] PUT /identity/v3/projects/9a2254fb03144287bd995bc11379a395/users/8348c56d8f094bdba5de1d8ead3ef79f/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:09.657364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:09.657733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:09.657910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:09.775722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] MFA Rules not processed for user `8348c56d8f094bdba5de1d8ead3ef79f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:09.777197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:10.044766 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1073/2142] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:10.056643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:10.058542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:10.179450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee47a1c-24e9-41f2-8950-6b449dff3225 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:10.189329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a3b7-0b8d-44a6-920d-23d13e97f48a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:10.190295 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a3b7-0b8d-44a6-920d-23d13e97f48a service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:10.190897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a3b7-0b8d-44a6-920d-23d13e97f48a service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:10.191316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a3b7-0b8d-44a6-920d-23d13e97f48a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:10.209941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a3b7-0b8d-44a6-920d-23d13e97f48a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:10.211417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a3b7-0b8d-44a6-920d-23d13e97f48a service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:10.259235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1070/2143] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:10.295876 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:10.333132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:10.438381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806f0dd-2ba2-4642-bd11-14b013155049 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:10.454153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:10.455534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:10.455811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:10.456081 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] PATH_INFO: `/v3/users/8348c56d8f094bdba5de1d8ead3ef79f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:10.459182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8348c56d8f094bdba5de1d8ead3ef79f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:10.461445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:10.598976 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8348c56d8f094bdba5de1d8ead3ef79f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:10.634614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8348c56d8f094bdba5de1d8ead3ef79f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:10.636698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8348c56d8f094bdba5de1d8ead3ef79f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:10.652252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8348c56d8f094bdba5de1d8ead3ef79f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:10.673079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8348c56d8f094bdba5de1d8ead3ef79f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:10.686798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1074/2144] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:10 2022] DELETE /identity/v3/users/8348c56d8f094bdba5de1d8ead3ef79f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:10.688498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:10.688983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:10.689102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:10.729979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:10.731401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:10.875293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1071/2145] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:10.918224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:10.919838 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:11.053849 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93279dd-9b25-4c91-9790-b776a8f5dd70 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:11.062609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86846ff8-198a-42bc-9bd8-98b8f84ba21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:11.063228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846ff8-198a-42bc-9bd8-98b8f84ba21d service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:11.063655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846ff8-198a-42bc-9bd8-98b8f84ba21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:11.063933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846ff8-198a-42bc-9bd8-98b8f84ba21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:11.085908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86846ff8-198a-42bc-9bd8-98b8f84ba21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:11.087373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86846ff8-198a-42bc-9bd8-98b8f84ba21d service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:11.115797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1075/2146] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:11.651342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:11.652822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:11.686301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf1ad5-a7f8-4687-a577-6f160c96a372 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:11.701139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:11.701964 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:11.702088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:11.702347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] PATH_INFO: `/v3/projects/9a2254fb03144287bd995bc11379a395` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:11.704057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2254fb03144287bd995bc11379a395)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:11.710962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:11.842219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2254fb03144287bd995bc11379a395', 'request_id': 'req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:11.857762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2254fb03144287bd995bc11379a395', 'request_id': 'req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:11.868425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2254fb03144287bd995bc11379a395', 'request_id': 'req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:11.906153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] The token cache is being invalidate because project 9a2254fb03144287bd995bc11379a395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:11.907588 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:11.909651 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2da1ed8-4875-49ae-9cb7-b5ffae2df7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:11.927291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1072/2147] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:11 2022] DELETE /identity/v3/projects/9a2254fb03144287bd995bc11379a395 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:11.930548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:11.931398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:11.931831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:11.997572 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:12.001061 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:12.134576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:12.221172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1076/2148] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:12.230505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:12.230791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:12.231064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:12.260730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:12.262065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:12.278878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1073/2149] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:12.283041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:12.313894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cdbf1-722e-471e-b7d6-5379c8ea7313 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:12.339411 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:12.341292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:12.342179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:12.343166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:12.353473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:12.354093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:12.359216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:12.405926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1077/2150] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:12.418018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:12.454806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63fca-92f0-4129-a860-2a5faf03471e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:12.463963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:12.465379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:12.465935 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:12.466580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:12.468462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:12.471083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:12.496831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:12.543680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1074/2151] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:12.545303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:12.566481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ea04f-8351-4347-8eb6-1fc1acb2066f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:12.713266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:12.714623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:12.714970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:12.715310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:12.716022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:12.718221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:12.772371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1078/2152] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:12 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:12.777249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:12.796090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d248-3be8-4286-8415-ee9cc4298eb5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:12.836726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:12.840949 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:12.841673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:12.842100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:12.844492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:12.849630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:12.892672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1075/2153] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:12.895029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:12.917460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69b10-a950-4521-acb6-2681c8d43f9e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:12.934276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc72c5-ece3-4973-bbd8-e36e0a90afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:12.935864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc72c5-ece3-4973-bbd8-e36e0a90afd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:12.936548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc72c5-ece3-4973-bbd8-e36e0a90afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:12.937382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc72c5-ece3-4973-bbd8-e36e0a90afd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:12.939875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc72c5-ece3-4973-bbd8-e36e0a90afd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:12.943224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc72c5-ece3-4973-bbd8-e36e0a90afd3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:12.989413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:12.997406 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1079/2154] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:07:13.005220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdcd6e-1e7a-4b2b-94fe-3770efa324dc admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:13.025244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:13.026747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:13.027422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:13.028124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] PATH_INFO: `/v3/projects/0b9071a26bfe4b759c693dc28b6cef69/users/771eca1324ac4b4299871f6effab3b7d/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:13.073445 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9071a26bfe4b759c693dc28b6cef69, user_id=771eca1324ac4b4299871f6effab3b7d, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:13.078281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:13.123796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1076/2155] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:12 2022] PUT /identity/v3/projects/0b9071a26bfe4b759c693dc28b6cef69/users/771eca1324ac4b4299871f6effab3b7d/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:13.135726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb393f7-fe51-4eff-9972-dac4c9cbe2d7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:13.136422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb393f7-fe51-4eff-9972-dac4c9cbe2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:13.136844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb393f7-fe51-4eff-9972-dac4c9cbe2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:13.184601 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3cb393f7-fe51-4eff-9972-dac4c9cbe2d7 None None] MFA Rules not processed for user `771eca1324ac4b4299871f6effab3b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:13.186346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3cb393f7-fe51-4eff-9972-dac4c9cbe2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:13.324886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1080/2156] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:13.338671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:13.340832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:13.519390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d717f0-b79b-4964-98c7-c428d1591384 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:13.525924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:13.526578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:13.526817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:13.527086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:13.552235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:13.553482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:13.569470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1077/2157] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:14.371749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:14.372685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:14.373227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:14.424933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] MFA Rules not processed for user `fd7dc257718a407ca0115039514e239b`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:14.426734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:14.500163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:14.592094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1081/2158] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:14.594494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:14.596135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:14.715773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd96bb8-3016-42dd-881a-ebbbecce66cb service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:14.727857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:14.728531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:14.728797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:14.729266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:14.730167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:14.733447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:14.805228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1078/2159] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:14 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:14.810393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:14.826685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cad53-d9ba-47a5-9416-84fe129b81e4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:15.045828 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:15.046904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:15.047451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:15.047893 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:15.048788 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:15.060067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:15.105659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1082/2160] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:14 2022] POST /identity/v3/users => generated 299 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:15.106380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:15.120215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2bba9-c002-491b-9804-628a0ea89631 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:15.131147 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:15.131724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:15.132003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:15.132274 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:15.132991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:15.134596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:15.148679 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1079/2161] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:15.153662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:15.176984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad902ad-ddf2-4422-9867-dd2aa6a5d1b4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:15.195304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d48ba8-d12b-40e4-b7b7-209accaac086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:15.195997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d48ba8-d12b-40e4-b7b7-209accaac086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:15.196276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d48ba8-d12b-40e4-b7b7-209accaac086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:15.196574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d48ba8-d12b-40e4-b7b7-209accaac086 admin admin] PATH_INFO: `/v3/projects/ec0faa1d2a33423ab240a5c534f8b119/users/2e2b4e23e8104e3ca730c92650c79c50/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:15.225480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d48ba8-d12b-40e4-b7b7-209accaac086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0faa1d2a33423ab240a5c534f8b119, user_id=2e2b4e23e8104e3ca730c92650c79c50, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:15.233189 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d48ba8-d12b-40e4-b7b7-209accaac086 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:15.272877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1083/2162] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:15 2022] PUT /identity/v3/projects/ec0faa1d2a33423ab240a5c534f8b119/users/2e2b4e23e8104e3ca730c92650c79c50/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:15.273944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:15.293317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226f2ed-6641-41e4-a6a3-a1c6e1d42b4e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:15.335206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:15.335776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:15.336268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:15.365324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:15.369671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] MFA Rules not processed for user `942dbf4686f84d9daa91fc33e38f59b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:15.372327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:15.431772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:15.432639 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:15.433223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:15.434238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:15.435188 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:15.437136 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:15.469071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1080/2163] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:07:15.477327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:15.504791 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45068fd7-32cf-435e-826f-1d1bd88813c5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:15.542845 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867fe0e-ff91-4ebb-8098-9577d4b37c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:15.543933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867fe0e-ff91-4ebb-8098-9577d4b37c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:15.544462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867fe0e-ff91-4ebb-8098-9577d4b37c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:15.544898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867fe0e-ff91-4ebb-8098-9577d4b37c0b admin admin] PATH_INFO: `/v3/projects/ec0faa1d2a33423ab240a5c534f8b119/users/2e2b4e23e8104e3ca730c92650c79c50/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:15.547112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1084/2164] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:15.552943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867fe0e-ff91-4ebb-8098-9577d4b37c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0faa1d2a33423ab240a5c534f8b119, user_id=2e2b4e23e8104e3ca730c92650c79c50, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:15.561795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867fe0e-ff91-4ebb-8098-9577d4b37c0b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:15.633961 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1081/2165] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:15 2022] PUT /identity/v3/projects/ec0faa1d2a33423ab240a5c534f8b119/users/2e2b4e23e8104e3ca730c92650c79c50/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:17.106032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:17.127003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a0ef1-30d7-45b9-99d4-20fc77e5f353 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:17.235942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:17.286942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:17.291487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:17.291844 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:17.292500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] PATH_INFO: `/v3/users/771eca1324ac4b4299871f6effab3b7d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:17.295294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] RBAC: Authorizing `identity:delete_user(user_id=771eca1324ac4b4299871f6effab3b7d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:17.306468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:17.489794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771eca1324ac4b4299871f6effab3b7d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:17.522074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771eca1324ac4b4299871f6effab3b7d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:17.525155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771eca1324ac4b4299871f6effab3b7d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:17.540719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771eca1324ac4b4299871f6effab3b7d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:17.565973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771eca1324ac4b4299871f6effab3b7d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:17.584814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1085/2166] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:17 2022] DELETE /identity/v3/users/771eca1324ac4b4299871f6effab3b7d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:17.589881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:17.590396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:17.590396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:17.629720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:17.635712 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:17.792827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1082/2167] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:17.796270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:17.802329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:17.991913 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042b157-d7ec-4ed2-a05c-fafa7df0714f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:18.004949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c141818-6943-4354-9d15-d95dc34b5ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:18.005579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141818-6943-4354-9d15-d95dc34b5ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:18.005853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141818-6943-4354-9d15-d95dc34b5ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:18.006120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141818-6943-4354-9d15-d95dc34b5ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:18.033254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141818-6943-4354-9d15-d95dc34b5ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:18.034704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141818-6943-4354-9d15-d95dc34b5ae5 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:18.067856 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1086/2168] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:19.266619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:19.268906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:19.291544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7f35c-dabc-4deb-b333-2b570c139352 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:19.312306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:19.315433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:19.317564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:19.319231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] PATH_INFO: `/v3/projects/0b9071a26bfe4b759c693dc28b6cef69` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:19.322922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9071a26bfe4b759c693dc28b6cef69)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:19.327435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:19.566866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9071a26bfe4b759c693dc28b6cef69', 'request_id': 'req-974a753d-4af7-42c9-9b7f-d4be395609b4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:19.611844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9071a26bfe4b759c693dc28b6cef69', 'request_id': 'req-974a753d-4af7-42c9-9b7f-d4be395609b4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:19.626898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9071a26bfe4b759c693dc28b6cef69', 'request_id': 'req-974a753d-4af7-42c9-9b7f-d4be395609b4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:19.644113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] The token cache is being invalidate because project 0b9071a26bfe4b759c693dc28b6cef69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:19.645026 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:19.645790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-974a753d-4af7-42c9-9b7f-d4be395609b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:19.648168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1083/2169] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:19 2022] DELETE /identity/v3/projects/0b9071a26bfe4b759c693dc28b6cef69 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:19.654753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:19.655365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:19.655365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:19.708580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:19.710129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:19.818850 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:19.855861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:19.856285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:19.856707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:19.868512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1087/2170] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:19.949515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:19.955997 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:19.978014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1084/2171] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:19.978688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:19.992126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc828-4d38-4ac2-ba43-252dbc3df84b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:20.013110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:20.013737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.014113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.014268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.015119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:20.015423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:20.017066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:20.063600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1088/2172] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:20.068229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:20.092454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9401e-767d-48b3-a30f-b028ee652641 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:20.120173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:20.123019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.123598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.123966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.124895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:20.131752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:20.208443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:20.211078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1085/2173] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:20 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:20.232487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f4101-c356-40e5-87fb-d0dfd5cbcc07 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:20.413254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:20.415829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.416477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.416477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.417071 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:20.419110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:20.468952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1089/2174] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:20 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:07:20.470749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:20.491209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d2f59-1697-493f-9f02-fad80b1f06b1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:20.515680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:20.515680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.515680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.515680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.516201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:20.517787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:20.537524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:20.562152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:20.568235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1086/2175] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:20.579398 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bab12-8bde-44b1-8cb0-e835c892047d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:20.603759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e873a9-81e6-4c34-9730-b5f55af4400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:20.604407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e873a9-81e6-4c34-9730-b5f55af4400a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.604688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e873a9-81e6-4c34-9730-b5f55af4400a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.604956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e873a9-81e6-4c34-9730-b5f55af4400a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.605610 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e873a9-81e6-4c34-9730-b5f55af4400a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:20.607558 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e873a9-81e6-4c34-9730-b5f55af4400a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:20.647750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:20.653094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1090/2176] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:07:20.660452 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f80c54-a28d-44dc-ad53-88c5b338c89f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:20.671092 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:20.673325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.674887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.675354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] PATH_INFO: `/v3/projects/482bb9ab61b448c7b0f9ab53485d59b4/users/28b6bb703514476293d862ffbcb34ef1/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.736906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482bb9ab61b448c7b0f9ab53485d59b4, user_id=28b6bb703514476293d862ffbcb34ef1, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:20.740003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:20.787635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1087/2177] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:20 2022] PUT /identity/v3/projects/482bb9ab61b448c7b0f9ab53485d59b4/users/28b6bb703514476293d862ffbcb34ef1/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:20.866793 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7348d-9fe4-4120-8fd4-117899b384b1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:20.867643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7348d-9fe4-4120-8fd4-117899b384b1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:20.868046 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7348d-9fe4-4120-8fd4-117899b384b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:20.917315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-61f7348d-9fe4-4120-8fd4-117899b384b1 None None] MFA Rules not processed for user `28b6bb703514476293d862ffbcb34ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:20.920680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-61f7348d-9fe4-4120-8fd4-117899b384b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:21.237993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1091/2178] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:21.254957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:21.262546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:21.412968 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d91ba-2331-4be4-bcd2-2e867a6aef01 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:21.421270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:21.422514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:21.422866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:21.423152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:21.437819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:21.439281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:21.463483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1088/2179] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:26.311092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f03f-da7e-4ebf-9799-5a5a1be532ab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:26.311626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f03f-da7e-4ebf-9799-5a5a1be532ab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:26.311715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f03f-da7e-4ebf-9799-5a5a1be532ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:26.412132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0c84f03f-da7e-4ebf-9799-5a5a1be532ab None None] MFA Rules not processed for user `2e2b4e23e8104e3ca730c92650c79c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:26.415345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0c84f03f-da7e-4ebf-9799-5a5a1be532ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:26.489551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:26.551505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1092/2180] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:27.417780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:27.419235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:27.491319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1045dd-5fae-4f55-9dce-d1e35d4ef5b2 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:27.504486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:27.504486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:27.504486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:27.504486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:27.504835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:27.575533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:27.577031 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:27.587899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1089/2181] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:27.787675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:27.788205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:27.788205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:27.812140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:27.813690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:27.942272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1093/2182] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:07:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:27.961710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:27.963208 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:28.021510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:28.062530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbb8ad-9f0e-43a4-b765-cbb3e7043611 service glance] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:28.076010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b77d3-2602-48bf-99a8-989417bab0d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:28.076730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b77d3-2602-48bf-99a8-989417bab0d6 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:28.076962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b77d3-2602-48bf-99a8-989417bab0d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:28.077785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b77d3-2602-48bf-99a8-989417bab0d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:28.094305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b77d3-2602-48bf-99a8-989417bab0d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:28.094305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b77d3-2602-48bf-99a8-989417bab0d6 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:28.115617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1090/2183] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:07:33.148923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:33.263609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b954a6-2df6-4192-8140-8ea2e8508f8d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:33.284477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:33.286279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:33.287563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:33.288604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] PATH_INFO: `/v3/users/28b6bb703514476293d862ffbcb34ef1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:33.299553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b6bb703514476293d862ffbcb34ef1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:33.303324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:33.416799 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b6bb703514476293d862ffbcb34ef1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:33.447872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b6bb703514476293d862ffbcb34ef1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:33.449159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b6bb703514476293d862ffbcb34ef1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:33.462557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b6bb703514476293d862ffbcb34ef1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:33.489642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b6bb703514476293d862ffbcb34ef1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:33.504014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1094/2184] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:33 2022] DELETE /identity/v3/users/28b6bb703514476293d862ffbcb34ef1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:33.508117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:33.509007 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:33.509552 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:33.547355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:33.548878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:33.638280 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1091/2185] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:33.649110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:33.653090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:33.665094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:33.776080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3765713-ac02-40f7-9d06-5a46cee090a3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:33.782866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf872-b248-4e13-b972-db05323c5bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:33.783684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf872-b248-4e13-b972-db05323c5bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:33.784305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf872-b248-4e13-b972-db05323c5bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:33.784957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf872-b248-4e13-b972-db05323c5bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:33.804031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adf872-b248-4e13-b972-db05323c5bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:33.805798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adf872-b248-4e13-b972-db05323c5bb6 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:33.818734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1095/2186] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:07:34.424769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:34.427484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:34.439813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a8c8d-14f9-4ba5-b88b-251495b00726 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:34.445105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:34.446039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:34.446622 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:34.447112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] PATH_INFO: `/v3/projects/482bb9ab61b448c7b0f9ab53485d59b4` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:34.448372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482bb9ab61b448c7b0f9ab53485d59b4)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:34.450749 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:34.530766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482bb9ab61b448c7b0f9ab53485d59b4', 'request_id': 'req-21e51307-d780-4788-b65a-9c5612f4df09'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:34.555265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482bb9ab61b448c7b0f9ab53485d59b4', 'request_id': 'req-21e51307-d780-4788-b65a-9c5612f4df09'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:34.563367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482bb9ab61b448c7b0f9ab53485d59b4', 'request_id': 'req-21e51307-d780-4788-b65a-9c5612f4df09'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:34.578097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] The token cache is being invalidate because project 482bb9ab61b448c7b0f9ab53485d59b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:34.578858 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:34.579643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-21e51307-d780-4788-b65a-9c5612f4df09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:34.583593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1092/2187] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:34 2022] DELETE /identity/v3/projects/482bb9ab61b448c7b0f9ab53485d59b4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:34.649427 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2fc8b-d6a1-49b7-8691-042e25489fb1 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:34.649986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2fc8b-d6a1-49b7-8691-042e25489fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:34.650097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2fc8b-d6a1-49b7-8691-042e25489fb1 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:34.651972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1096/2188] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:07:34.680223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2119d5-1312-4c24-95a3-c6c71525b31c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:34.680601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2119d5-1312-4c24-95a3-c6c71525b31c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:34.680827 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2119d5-1312-4c24-95a3-c6c71525b31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:34.705314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ab2119d5-1312-4c24-95a3-c6c71525b31c None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:34.706607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ab2119d5-1312-4c24-95a3-c6c71525b31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:34.798146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:34.841947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1093/2189] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:07:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:39.003391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2fc8b-d6a1-49b7-8691-042e25489fb1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:39.005879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-60b2fc8b-d6a1-49b7-8691-042e25489fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:39.131964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2fc8b-d6a1-49b7-8691-042e25489fb1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:39.139656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:39.140327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:39.140649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:39.140914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] PATH_INFO: `/v3/users/2b744adf61a64188829e904ccec6052f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:39.142174 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b744adf61a64188829e904ccec6052f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:39.144971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:39.276323 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b744adf61a64188829e904ccec6052f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:39.293888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b744adf61a64188829e904ccec6052f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:39.294713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b744adf61a64188829e904ccec6052f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:39.303028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b744adf61a64188829e904ccec6052f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:39.312034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b744adf61a64188829e904ccec6052f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:39.319217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1097/2190] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:39 2022] DELETE /identity/v3/users/2b744adf61a64188829e904ccec6052f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:39.323693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:39.324140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:39.324542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:39.349065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:39.351157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:39.432456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1094/2191] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:39.442748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:39.444229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:39.484651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:39.538727 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9ee5-909b-4a82-9e14-f686c5432fe3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:39.542509 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:39.543116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:39.543397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:39.543667 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:39.554259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:39.555697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:39.566373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1098/2192] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:39.916746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:39.918224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:39.995223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:39.997152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.019175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8fb7-62e9-499f-8313-5b56ed6d599b service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.024996 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.025831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.026196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.026594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] PATH_INFO: `/v3/projects/f1d502242d05414eb550a11f6ae4b69f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.028721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d502242d05414eb550a11f6ae4b69f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.035473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.053025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0af72-5ccf-4932-9e0c-112065809935 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.056724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd246bbbfb444cd19f8e53157e2973e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.057407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.057756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.058035 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.060205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.088130 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d502242d05414eb550a11f6ae4b69f', 'request_id': 'req-71091f54-aa39-49c2-a351-fa91b850e3e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:40.105537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d502242d05414eb550a11f6ae4b69f', 'request_id': 'req-71091f54-aa39-49c2-a351-fa91b850e3e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:40.113890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d502242d05414eb550a11f6ae4b69f', 'request_id': 'req-71091f54-aa39-49c2-a351-fa91b850e3e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:40.126989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] The token cache is being invalidate because project f1d502242d05414eb550a11f6ae4b69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:40.127278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:40.128497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71091f54-aa39-49c2-a351-fa91b850e3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:40.129991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1099/2193] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:39 2022] DELETE /identity/v3/projects/f1d502242d05414eb550a11f6ae4b69f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:40.131229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4c7a-8c75-44be-9d6c-97644ff02e06 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.131506 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4c7a-8c75-44be-9d6c-97644ff02e06 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.131771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4c7a-8c75-44be-9d6c-97644ff02e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.152069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-53ea4c7a-8c75-44be-9d6c-97644ff02e06 None None] MFA Rules not processed for user `fd7dc257718a407ca0115039514e239b`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:40.153390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53ea4c7a-8c75-44be-9d6c-97644ff02e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.153633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.155085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6dd90-df47-4f8c-9d11-20caf48ab4c3 service glance] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.168231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1095/2194] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:40.172123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a522b0-163a-4e17-9230-5c45850f339a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.172695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a522b0-163a-4e17-9230-5c45850f339a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.173598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a522b0-163a-4e17-9230-5c45850f339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.199981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-96a522b0-163a-4e17-9230-5c45850f339a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:40.201476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-96a522b0-163a-4e17-9230-5c45850f339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.212814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1100/2195] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:40.215967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:40.248160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2540-5ccc-498c-81a9-00d472401c86 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.248504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2540-5ccc-498c-81a9-00d472401c86 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.248787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2540-5ccc-498c-81a9-00d472401c86 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.250522 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1101/2196] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:07:40.256543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.256833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.257110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.281808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:40.283140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.286085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1096/2197] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:40.294232 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.294524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.295840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.319861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:40.321130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.333081 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1097/2198] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:40.334215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.343395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7cf7c-88e2-4f80-84de-ec102e4b61dd None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.349239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.349414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1102/2199] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:40.349598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.349878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.350156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.350886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:40.351189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.353091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.365377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.366943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.376161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1098/2200] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:40.376388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:40.379006 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.381765 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4169c72-b507-4389-95aa-6056dbe996fd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.389525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.390152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.390432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.390709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.392788 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbc0cf-bf20-4b73-b607-96a4f9324a3f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.399335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.400779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850f6b8-135d-4412-b2e9-9919c2926002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.400925 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.401659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f6b8-135d-4412-b2e9-9919c2926002 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.402095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f6b8-135d-4412-b2e9-9919c2926002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.402519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f6b8-135d-4412-b2e9-9919c2926002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.403319 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850f6b8-135d-4412-b2e9-9919c2926002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.405655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850f6b8-135d-4412-b2e9-9919c2926002 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.409143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1103/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:07:40.443869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1099/2202] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:07:40.445101 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.459100 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81665d-b2a4-46a8-9d47-bdac5becbcdb service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.511173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d276-d5de-45f7-b608-4976555cc308 None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.511819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d276-d5de-45f7-b608-4976555cc308 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.512192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d276-d5de-45f7-b608-4976555cc308 None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.513940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1100/2203] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 26 11:07:40.519833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.520114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.520426 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.532320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.533182 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.533656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.536676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.537731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.540515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.545826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:40.547169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.576574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1104/2204] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:07:40.580741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.600989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa3c0-0970-4517-9047-edee4dd6225e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.611354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.612614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.612895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.613166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.613847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.615547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.626379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1105/2205] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:07:40.630324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.640455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df423b-ef5f-4a83-8a8a-dd6b225df8fb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.646419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.647035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.647311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.647578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.648229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.649830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.652218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1101/2206] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:40.663661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.668544 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1106/2207] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:40.672824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.684770 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dd2a1-0fa1-4f8b-adb8-f11acd753e8a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.689714 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830f8e-10b2-43b1-9200-85949b2f3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.690403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830f8e-10b2-43b1-9200-85949b2f3a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.690723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830f8e-10b2-43b1-9200-85949b2f3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.691000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830f8e-10b2-43b1-9200-85949b2f3a10 admin admin] PATH_INFO: `/v3/projects/547ed82e3ccd4558b2cbef5533c45cff/users/2bc05c9587ce4e28814bbed9e484a344/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.707715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830f8e-10b2-43b1-9200-85949b2f3a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547ed82e3ccd4558b2cbef5533c45cff, user_id=2bc05c9587ce4e28814bbed9e484a344, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.712638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830f8e-10b2-43b1-9200-85949b2f3a10 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.739557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1107/2208] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:40 2022] PUT /identity/v3/projects/547ed82e3ccd4558b2cbef5533c45cff/users/2bc05c9587ce4e28814bbed9e484a344/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:40.740468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e8e2-7c7b-41d5-a47a-7de9aca67446 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.741821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.742113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.742392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.773709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:40.778304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] MFA Rules not processed for user `2bc05c9587ce4e28814bbed9e484a344`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:40.779516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.806439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943c91d-2c03-4f43-a794-cd4248ae7e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.807159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943c91d-2c03-4f43-a794-cd4248ae7e5a service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.807410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943c91d-2c03-4f43-a794-cd4248ae7e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.807725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943c91d-2c03-4f43-a794-cd4248ae7e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:40.871955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1108/2209] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:40.886031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:40.888096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:40.918055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943c91d-2c03-4f43-a794-cd4248ae7e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:40.920265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943c91d-2c03-4f43-a794-cd4248ae7e5a service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:40.933988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1102/2210] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:07:40.936499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:40.977733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736eed0-7419-453b-b411-4d75eb75c654 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:40.981530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:40.982218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:40.982567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:40.982910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:41.002380 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:41.004418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:41.016047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1109/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:07:42.636407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:42.636407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:42.636407 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:42.657514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:42.659168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:42.765197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1103/2212] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:07:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:42.781273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:42.784392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:42.872362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a83e6d-63ab-44ba-b395-5753fe31fd51 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:42.879041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305c48-b3b9-4afe-a2a4-deff66ee6a18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:42.879628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305c48-b3b9-4afe-a2a4-deff66ee6a18 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:42.879989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305c48-b3b9-4afe-a2a4-deff66ee6a18 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:42.880299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305c48-b3b9-4afe-a2a4-deff66ee6a18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:42.890428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305c48-b3b9-4afe-a2a4-deff66ee6a18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:42.892099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305c48-b3b9-4afe-a2a4-deff66ee6a18 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:42.901955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1110/2213] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:07:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:07:51.754461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:51.826428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b989da-ddbd-49e1-b3dd-c23098c56941 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:51.831863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:51.832515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:51.832795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:51.833068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] PATH_INFO: `/v3/users/2bc05c9587ce4e28814bbed9e484a344` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:51.834198 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc05c9587ce4e28814bbed9e484a344)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:51.836113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:51.850013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:51.884586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc05c9587ce4e28814bbed9e484a344'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:51.896100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc05c9587ce4e28814bbed9e484a344'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:51.896796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc05c9587ce4e28814bbed9e484a344'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:51.903690 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc05c9587ce4e28814bbed9e484a344'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:51.911038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc05c9587ce4e28814bbed9e484a344'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:51.917209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1104/2214] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:07:51 2022] DELETE /identity/v3/users/2bc05c9587ce4e28814bbed9e484a344 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:07:51.921713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:51.922262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:51.922262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:51.942113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:51.943311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:52.001118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1111/2215] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:52.011329 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:52.012757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:52.073519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bec87-742d-4952-aa91-4f00c8c192b5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:52.081852 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff3eaa-f62f-4a96-938d-97b2eafa57dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:52.082476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff3eaa-f62f-4a96-938d-97b2eafa57dc service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:52.082923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff3eaa-f62f-4a96-938d-97b2eafa57dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:52.083607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff3eaa-f62f-4a96-938d-97b2eafa57dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:52.094799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff3eaa-f62f-4a96-938d-97b2eafa57dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:52.096796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff3eaa-f62f-4a96-938d-97b2eafa57dc service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:52.109012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1105/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:53.044832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.046355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.058092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e4db-fb8a-45b0-88db-9860609d975a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.063987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.064776 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.065614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.065890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] PATH_INFO: `/v3/projects/547ed82e3ccd4558b2cbef5533c45cff` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.067212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547ed82e3ccd4558b2cbef5533c45cff)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.069368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.158631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547ed82e3ccd4558b2cbef5533c45cff', 'request_id': 'req-d708c01b-ea29-496d-9c3c-140a64bf2b69'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:53.161124 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:53.167887 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547ed82e3ccd4558b2cbef5533c45cff', 'request_id': 'req-d708c01b-ea29-496d-9c3c-140a64bf2b69'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:53.178356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547ed82e3ccd4558b2cbef5533c45cff', 'request_id': 'req-d708c01b-ea29-496d-9c3c-140a64bf2b69'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:53.191898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] The token cache is being invalidate because project 547ed82e3ccd4558b2cbef5533c45cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:07:53.192195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:53.192899 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d708c01b-ea29-496d-9c3c-140a64bf2b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:07:53.194678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1112/2217] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:07:53 2022] DELETE /identity/v3/projects/547ed82e3ccd4558b2cbef5533c45cff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:53.199559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.200046 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.200145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.220781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:53.222017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.288048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1106/2218] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:53.295832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.296117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.296470 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.317603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:53.318815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.326675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1113/2219] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:53.330919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.340437 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655389-8462-4ba0-b6d8-32e9d63e9acc None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.345055 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.345648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.345925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.346229 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.346866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:07:53.347164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.348765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.366212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1107/2220] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:07:53.370836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.381205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e67d1-7566-4774-a801-6ff9b69d4c3b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.386286 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.386970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.387256 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.387526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.388168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.390088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.425944 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1114/2221] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:07:53 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:07:53.427100 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.452173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55b297-b03a-4fbb-948d-e17a957e81b0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.499379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:53.577228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.577836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.578124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.578402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.579016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.581563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.602417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1108/2222] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:07:53 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:07:53.606551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.616987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e60c6-8518-400a-b252-6c2ff1963220 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.621615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.622206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.622486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.622756 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.623392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.625027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.635988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1115/2223] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:53.640000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.653017 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170e8b-7be8-43d6-9daa-617b409b35b2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.659528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430b16-c7d0-49f5-9dcd-5fa193a8c83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.660665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430b16-c7d0-49f5-9dcd-5fa193a8c83a admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.660942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430b16-c7d0-49f5-9dcd-5fa193a8c83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.661839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430b16-c7d0-49f5-9dcd-5fa193a8c83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.662553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430b16-c7d0-49f5-9dcd-5fa193a8c83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.664231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430b16-c7d0-49f5-9dcd-5fa193a8c83a admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.676170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1109/2224] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:07:53.680726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.705311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a25227-912f-4b63-9384-77743be8f282 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.713044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e4ca2-be86-4a0b-8c06-81a733ce2cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.713947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e4ca2-be86-4a0b-8c06-81a733ce2cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.714329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e4ca2-be86-4a0b-8c06-81a733ce2cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.714729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e4ca2-be86-4a0b-8c06-81a733ce2cd8 admin admin] PATH_INFO: `/v3/projects/18afad86c63a4fe4af2ce369ea7857f1/users/0820152815e348c49c4438dd7a9a56e7/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.730978 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907756-862c-4fa5-8324-516317d0097c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.731240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907756-862c-4fa5-8324-516317d0097c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.731511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907756-862c-4fa5-8324-516317d0097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.732086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e4ca2-be86-4a0b-8c06-81a733ce2cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18afad86c63a4fe4af2ce369ea7857f1, user_id=0820152815e348c49c4438dd7a9a56e7, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.735368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e4ca2-be86-4a0b-8c06-81a733ce2cd8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.752063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1116/2225] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:07:53 2022] PUT /identity/v3/projects/18afad86c63a4fe4af2ce369ea7857f1/users/0820152815e348c49c4438dd7a9a56e7/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:07:53.755084 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6a907756-862c-4fa5-8324-516317d0097c None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:53.756290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6a907756-862c-4fa5-8324-516317d0097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.763943 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.764230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.764623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.794555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] MFA Rules not processed for user `0820152815e348c49c4438dd7a9a56e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:53.795783 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.832991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1110/2226] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:53.847298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907756-862c-4fa5-8324-516317d0097c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.848786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6a907756-862c-4fa5-8324-516317d0097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.874193 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1117/2227] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:07:53.885257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:53.886927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:53.929717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907756-862c-4fa5-8324-516317d0097c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.935479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b597c-8f67-4284-84b7-874bcbfa98e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.936167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b597c-8f67-4284-84b7-874bcbfa98e7 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.936485 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b597c-8f67-4284-84b7-874bcbfa98e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.936760 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b597c-8f67-4284-84b7-874bcbfa98e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.946309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b597c-8f67-4284-84b7-874bcbfa98e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.947904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b597c-8f67-4284-84b7-874bcbfa98e7 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.948292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cd1a1-1955-4cca-89d1-3b45f3b509f8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:53.952269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:53.953015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:53.953358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:53.953695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:53.957766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1111/2228] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 26 11:07:53.964127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:53.965753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:53.976721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1118/2229] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:07:55.314657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fcfd3-be40-4c73-be3a-980aa24eac77 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:55.315259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fcfd3-be40-4c73-be3a-980aa24eac77 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:55.315259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fcfd3-be40-4c73-be3a-980aa24eac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:55.335561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6f9fcfd3-be40-4c73-be3a-980aa24eac77 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:55.336811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6f9fcfd3-be40-4c73-be3a-980aa24eac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:55.369015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:55.402146 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1112/2230] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:07:55.443587 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:07:55.444565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:55.460272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:07:55.544525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11f8d-5454-4a48-a978-ba4ae1553c5d service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:07:55.550451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d4188-b0f3-44bf-acec-1611924552f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:07:55.551239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d4188-b0f3-44bf-acec-1611924552f5 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:55.551526 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d4188-b0f3-44bf-acec-1611924552f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:55.551806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d4188-b0f3-44bf-acec-1611924552f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:55.561091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d4188-b0f3-44bf-acec-1611924552f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:07:55.562892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d4188-b0f3-44bf-acec-1611924552f5 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:07:55.585134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1119/2231] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:07:55.593078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630bfe-a19b-4c20-9104-4de20edb8fb0 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:07:55.593536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630bfe-a19b-4c20-9104-4de20edb8fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:07:55.593965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630bfe-a19b-4c20-9104-4de20edb8fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:07:55.644291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-a7630bfe-a19b-4c20-9104-4de20edb8fb0 None None] MFA Rules not processed for user `0820152815e348c49c4438dd7a9a56e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:07:55.646152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a7630bfe-a19b-4c20-9104-4de20edb8fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:07:55.664237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1113/2232] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:07:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:04.282275 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183112-dfa5-4870-a35b-bc53989ceeac None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:04.282842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183112-dfa5-4870-a35b-bc53989ceeac None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:04.283781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183112-dfa5-4870-a35b-bc53989ceeac None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:04.285228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1120/2233] 10.222.0.49 () {54 vars in 961 bytes} [Wed Oct 26 11:08:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:08:04.291116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:04.291655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:04.291931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:04.313245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] MFA Rules not processed for user `b273370ae8bd45098d44997b5b2c6a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:04.314458 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:04.325613 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183112-dfa5-4870-a35b-bc53989ceeac None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:04.327957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b7183112-dfa5-4870-a35b-bc53989ceeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:04.393958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1114/2234] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Oct 26 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:08:04.394860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:04.404492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fd88-31c9-4d8c-b369-281f68073041 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:04.410264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:04.410873 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:04.411155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:04.411428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:04.413249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:04.418754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183112-dfa5-4870-a35b-bc53989ceeac None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:04.423931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:04.424931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:04.425312 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:04.425715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:04.427068 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:04.428701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f0146-f75a-4e2d-b51b-c61158399f45 service placement] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:04.435982 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:04.437698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:04.438908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1115/2235] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:08:04.449173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1121/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:08:09.791893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88e5ea-89ce-4c19-a850-d94a902bdc0b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:09.792832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88e5ea-89ce-4c19-a850-d94a902bdc0b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:09.793114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88e5ea-89ce-4c19-a850-d94a902bdc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:09.817775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6d88e5ea-89ce-4c19-a850-d94a902bdc0b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:09.819451 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6d88e5ea-89ce-4c19-a850-d94a902bdc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:09.835137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1116/2237] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:09.867735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:09.869248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:09.886369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d0d0-0b5f-4cf2-9985-d44f46ec7be1 service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:09.892685 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:09.894153 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:09.894505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:09.894848 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:09.904479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:09.906599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:09.919186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1122/2238] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:12.208655 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f6eb0-d1ab-420e-b335-9cbe3d832fb6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:12.209110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f6eb0-d1ab-420e-b335-9cbe3d832fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:12.209217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f6eb0-d1ab-420e-b335-9cbe3d832fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:12.228797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f65f6eb0-d1ab-420e-b335-9cbe3d832fb6 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:12.229995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f65f6eb0-d1ab-420e-b335-9cbe3d832fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:12.237379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1117/2239] 10.222.0.49 () {58 vars in 967 bytes} [Wed Oct 26 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:12.250013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:12.261093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaaae-9e7d-4adb-882c-ea572a891b0e service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:12.266059 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:12.266645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:12.266921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:12.267192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:12.275994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:12.277592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:12.286407 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1123/2240] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:08:14.019767 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcc786-8796-4fa7-a1d4-82fccdf6a07b None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:14.020373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcc786-8796-4fa7-a1d4-82fccdf6a07b None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:14.020373 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcc786-8796-4fa7-a1d4-82fccdf6a07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:14.039778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-fcfcc786-8796-4fa7-a1d4-82fccdf6a07b None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:14.041016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fcfcc786-8796-4fa7-a1d4-82fccdf6a07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:14.048912 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1118/2241] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:14.062009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:14.074082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e633a-453d-4aba-92b2-bc851ab9695a service swift] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:14.079385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:14.079965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:14.080241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:14.080539 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:14.089117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:14.090673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:14.102536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1124/2242] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:18.148214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:18.148724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:18.148965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:18.172207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:18.173450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:18.181356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1119/2243] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:18.198569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:18.210331 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7162f-0231-4295-a4c8-3a28b6a8f31e service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:18.215807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c003f8a-b0da-4904-b5d9-d430eaf44062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:18.216446 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c003f8a-b0da-4904-b5d9-d430eaf44062 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:18.216726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c003f8a-b0da-4904-b5d9-d430eaf44062 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:18.216991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c003f8a-b0da-4904-b5d9-d430eaf44062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:18.226579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c003f8a-b0da-4904-b5d9-d430eaf44062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:18.228152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c003f8a-b0da-4904-b5d9-d430eaf44062 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:18.238341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1125/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:21.830930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:21.832402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:21.907907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d5c75-bb5e-4a59-bd71-7d5b1abf897e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:21.914087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:21.915646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:21.916065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:21.916368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:21.918185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:21.967553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:22.000093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:22.001584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:22.012181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1120/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:22.341922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad6d26-f3b7-45d1-9d9a-84c2f90c2380 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:22.342433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad6d26-f3b7-45d1-9d9a-84c2f90c2380 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:22.342527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad6d26-f3b7-45d1-9d9a-84c2f90c2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:22.364415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-19ad6d26-f3b7-45d1-9d9a-84c2f90c2380 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:22.365637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-19ad6d26-f3b7-45d1-9d9a-84c2f90c2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:22.374632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1126/2246] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:08:22.394169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:22.406536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9fa04-6806-4b98-a86d-e8698648b2de service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:22.413593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:22.414207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:22.414491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:22.414884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:22.423931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:22.426138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:22.436019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1121/2247] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:27.598581 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65f03-3948-4eba-ac19-afe7a98f5ec8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:27.599140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65f03-3948-4eba-ac19-afe7a98f5ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:27.599140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65f03-3948-4eba-ac19-afe7a98f5ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:27.608758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:27.626884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2eb65f03-3948-4eba-ac19-afe7a98f5ec8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:27.628492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2eb65f03-3948-4eba-ac19-afe7a98f5ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:27.637024 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1127/2248] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:27.669180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:27.681276 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ddfd-309c-4e08-8d1a-fae33329dec7 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:27.686869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:27.687528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:27.687870 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:27.688205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:27.696701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:27.698272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:27.708550 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1122/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:28.312897 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1c96-2a12-4d7b-a334-50eae73c7058 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:28.313866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1c96-2a12-4d7b-a334-50eae73c7058 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:28.314152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1c96-2a12-4d7b-a334-50eae73c7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:28.335060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d6de1c96-2a12-4d7b-a334-50eae73c7058 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:28.336248 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d6de1c96-2a12-4d7b-a334-50eae73c7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:28.343333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1128/2250] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:28.355263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:28.366551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd555-1d19-4fe8-8823-8f35551069c8 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:28.371405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:28.371984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:28.372260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:28.372589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:28.380899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:28.382456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:28.390142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1123/2251] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 26 11:08:28.920981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f01b8-8030-4d00-a00d-1238f0dbc275 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:28.921541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f01b8-8030-4d00-a00d-1238f0dbc275 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:28.921704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f01b8-8030-4d00-a00d-1238f0dbc275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:28.941931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-278f01b8-8030-4d00-a00d-1238f0dbc275 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:28.943132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-278f01b8-8030-4d00-a00d-1238f0dbc275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:28.950241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1129/2252] 10.222.0.49 () {58 vars in 967 bytes} [Wed Oct 26 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:28.963820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:28.975917 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e95b61-83e9-4afd-9422-c77df5303c2e service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:28.981105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:28.981755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:28.982214 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:28.982489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:28.992237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:28.993865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:29.001781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1124/2253] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:08:29.221875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304129de-1564-4132-a10e-59edf486b832 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:29.222162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304129de-1564-4132-a10e-59edf486b832 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:29.222438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304129de-1564-4132-a10e-59edf486b832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:29.242605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-304129de-1564-4132-a10e-59edf486b832 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:29.243802 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-304129de-1564-4132-a10e-59edf486b832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:29.250911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1130/2254] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:08:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:29.263414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:29.276493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8948-4648-4fc3-af1a-6a67d24c7c99 service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:29.282083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:29.282682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:29.283148 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:29.283418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:29.293528 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:29.295199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:29.304927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1125/2255] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:08:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:08:29.627159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:29.627626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:29.627958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:29.647824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:29.649054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:29.656070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1131/2256] 10.222.0.49 () {58 vars in 967 bytes} [Wed Oct 26 11:08:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:29.668728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:29.679597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b005c-c4db-4b6d-a70f-7631d446aa90 service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:29.684598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75433eb-db5e-4c2d-963b-6f4b281ddfe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:29.685185 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75433eb-db5e-4c2d-963b-6f4b281ddfe9 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:29.685466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75433eb-db5e-4c2d-963b-6f4b281ddfe9 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:29.685740 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75433eb-db5e-4c2d-963b-6f4b281ddfe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:29.693563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75433eb-db5e-4c2d-963b-6f4b281ddfe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:29.695123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75433eb-db5e-4c2d-963b-6f4b281ddfe9 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:29.702955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1126/2257] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:08:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:08:31.845732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:31.858640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cb7b0-edc9-4e15-8c3b-176b1708bb34 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:31.864504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:31.865143 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:31.865450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:31.865726 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] PATH_INFO: `/v3/users/0820152815e348c49c4438dd7a9a56e7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:31.866866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0820152815e348c49c4438dd7a9a56e7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:31.868817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:31.915337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0820152815e348c49c4438dd7a9a56e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:31.926997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0820152815e348c49c4438dd7a9a56e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:31.927647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0820152815e348c49c4438dd7a9a56e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:31.934340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0820152815e348c49c4438dd7a9a56e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:31.942028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0820152815e348c49c4438dd7a9a56e7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:31.948037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1132/2258] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:08:31 2022] DELETE /identity/v3/users/0820152815e348c49c4438dd7a9a56e7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:08:31.952545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:31.953014 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:31.953128 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:31.972484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:31.973685 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:32.033808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1127/2259] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:32.048655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:32.048655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:32.103352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0997cd-150f-47f2-9c7c-f82b7dc8d4fe admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:32.107098 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea99c4-77ef-4ae1-94c2-267bfdb171d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:32.107700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea99c4-77ef-4ae1-94c2-267bfdb171d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:32.107978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea99c4-77ef-4ae1-94c2-267bfdb171d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:32.108253 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea99c4-77ef-4ae1-94c2-267bfdb171d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:32.118162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea99c4-77ef-4ae1-94c2-267bfdb171d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:32.119596 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea99c4-77ef-4ae1-94c2-267bfdb171d2 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:32.129703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1133/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:08:32.389926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:32.391723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:32.405067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491d31a-5f94-4cb4-89fb-86f10b62e368 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:32.410432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:32.411438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:32.421150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:32.421967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] PATH_INFO: `/v3/projects/18afad86c63a4fe4af2ce369ea7857f1` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:32.423520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18afad86c63a4fe4af2ce369ea7857f1)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:32.425903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:32.476987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18afad86c63a4fe4af2ce369ea7857f1', 'request_id': 'req-0726a04c-e0ad-4c91-9020-dccb3f86fe72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:32.478675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:32.485331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18afad86c63a4fe4af2ce369ea7857f1', 'request_id': 'req-0726a04c-e0ad-4c91-9020-dccb3f86fe72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:32.491942 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18afad86c63a4fe4af2ce369ea7857f1', 'request_id': 'req-0726a04c-e0ad-4c91-9020-dccb3f86fe72'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:32.504005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] The token cache is being invalidate because project 18afad86c63a4fe4af2ce369ea7857f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:08:32.504278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:32.504979 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-0726a04c-e0ad-4c91-9020-dccb3f86fe72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:08:32.506433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1128/2261] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:08:32 2022] DELETE /identity/v3/projects/18afad86c63a4fe4af2ce369ea7857f1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:08:42.124854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=69,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:42.500840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=6 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:42.916945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbbdd-83a6-42ae-9b31-897db7d5cfcc None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:42.917224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbbdd-83a6-42ae-9b31-897db7d5cfcc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:42.917499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbbdd-83a6-42ae-9b31-897db7d5cfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:42.936107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-344cbbdd-83a6-42ae-9b31-897db7d5cfcc None None] MFA Rules not processed for user `06f2b753703942a9a770249abcdae36f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:42.937345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-344cbbdd-83a6-42ae-9b31-897db7d5cfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:42.993280 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1134/2262] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:43.084575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:43.084861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:43.085135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:43.111860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] MFA Rules not processed for user `942dbf4686f84d9daa91fc33e38f59b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:43.113137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:43.169903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1129/2263] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:52.986068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=25 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:53.163151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=25 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:08:59.463540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a9ec-0aed-4393-94e4-0dddfb1ffecd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:59.464116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a9ec-0aed-4393-94e4-0dddfb1ffecd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:59.464116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a9ec-0aed-4393-94e4-0dddfb1ffecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:59.485109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-36c9a9ec-0aed-4393-94e4-0dddfb1ffecd None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:08:59.486593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-36c9a9ec-0aed-4393-94e4-0dddfb1ffecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:59.547054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1135/2264] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:08:59.562269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:08:59.563835 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:08:59.648371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8b364-3bb3-4ef4-817a-6bd950839632 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:08:59.653397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:08:59.653945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:08:59.654222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:08:59.654492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:08:59.665284 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:08:59.667457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:08:59.679813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1130/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:02.729452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93852c-c281-4333-beb1-d470cdb550d7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:02.730221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93852c-c281-4333-beb1-d470cdb550d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:02.730659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93852c-c281-4333-beb1-d470cdb550d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:02.752683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4f93852c-c281-4333-beb1-d470cdb550d7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:02.754438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4f93852c-c281-4333-beb1-d470cdb550d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:02.762697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1136/2266] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:02.779326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:02.793133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfa37e-3788-41c9-b6dc-ea273e9b2301 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:02.799493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4da93a-2437-4185-a884-ad97473960fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:02.800099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da93a-2437-4185-a884-ad97473960fd service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:02.800432 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da93a-2437-4185-a884-ad97473960fd service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:02.800704 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4da93a-2437-4185-a884-ad97473960fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:02.811243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4da93a-2437-4185-a884-ad97473960fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:02.813209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4da93a-2437-4185-a884-ad97473960fd service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:02.832486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1131/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 26 11:09:03.618118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:03.618405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:03.618677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:03.637487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] MFA Rules not processed for user `3a46686f6d2444459088c321683566e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:03.638688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:03.698552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1137/2268] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:05.826824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2ccb-0d57-461b-b48e-93376d12500f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:05.827342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2ccb-0d57-461b-b48e-93376d12500f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:05.827448 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2ccb-0d57-461b-b48e-93376d12500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:05.846899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1e7e2ccb-0d57-461b-b48e-93376d12500f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:05.848657 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1e7e2ccb-0d57-461b-b48e-93376d12500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:05.856548 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1132/2269] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:09:05.879920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:05.881355 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:05.897736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071428c-97cc-45c8-8f44-eb0886eb2c0e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:05.903753 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:05.904472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:05.904841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:05.905177 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:05.914284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:05.915872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:05.925329 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1138/2270] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:08.971663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5236b-297b-492f-8fbb-ae1a60fc04a8 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:08.972705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5236b-297b-492f-8fbb-ae1a60fc04a8 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:08.973013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5236b-297b-492f-8fbb-ae1a60fc04a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:08.992715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-47d5236b-297b-492f-8fbb-ae1a60fc04a8 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:08.993911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-47d5236b-297b-492f-8fbb-ae1a60fc04a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:09.002212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1133/2271] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:09.032306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:09.043855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c50e94-2093-4f64-952f-755c1117401d service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:09.050233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:09.050898 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:09.051218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:09.051495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:09.060593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:09.062117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:09.071882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1139/2272] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:12.147938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:12.148435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:12.148549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:12.168642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:12.169832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:12.177578 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1134/2273] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Oct 26 11:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:12.193087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:12.204290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8499-9179-4030-9689-3b278d908ae1 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:12.210968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:12.211500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:12.211777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:12.212048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:12.220363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:12.221994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:12.231737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1140/2274] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:22.163363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=49 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:22.227635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=73 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:41.884213 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:41.885706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:41.898727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cb70b-15e5-47bb-94c2-ce122996353c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:41.903238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:41.903863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:41.904140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:41.904440 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] PATH_INFO: `/v3/users/06f2b753703942a9a770249abcdae36f` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:41.905547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f2b753703942a9a770249abcdae36f)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:41.907456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:41.954907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f2b753703942a9a770249abcdae36f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:41.967908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f2b753703942a9a770249abcdae36f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:41.968634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f2b753703942a9a770249abcdae36f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:41.975759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f2b753703942a9a770249abcdae36f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:41.983541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f2b753703942a9a770249abcdae36f'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:41.990149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1135/2275] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:09:41 2022] DELETE /identity/v3/users/06f2b753703942a9a770249abcdae36f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:09:42.242332 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:42.259175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229135b-9980-4635-96ab-53c0cb0c3d5f service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:42.316067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:42.316717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:42.316997 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:42.317269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] PATH_INFO: `/v3/projects/bab30a768d6f4d4b955bc1b135bee84c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:42.318369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab30a768d6f4d4b955bc1b135bee84c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:42.320296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:42.364927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab30a768d6f4d4b955bc1b135bee84c', 'request_id': 'req-4128c772-4e84-40b6-9cc5-fa4a95ea1650'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:42.372552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab30a768d6f4d4b955bc1b135bee84c', 'request_id': 'req-4128c772-4e84-40b6-9cc5-fa4a95ea1650'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:42.377906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab30a768d6f4d4b955bc1b135bee84c', 'request_id': 'req-4128c772-4e84-40b6-9cc5-fa4a95ea1650'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:42.389393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] The token cache is being invalidate because project bab30a768d6f4d4b955bc1b135bee84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:09:42.389681 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:42.390305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:42.391764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1141/2276] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:09:42 2022] DELETE /identity/v3/projects/bab30a768d6f4d4b955bc1b135bee84c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:09:48.630503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:48.632759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:48.647260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13807-4ef2-489c-90ab-e219d784ebd2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:48.707955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:48.708459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:48.708642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:48.709051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] PATH_INFO: `/v3/users/942dbf4686f84d9daa91fc33e38f59b8` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:48.710351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=942dbf4686f84d9daa91fc33e38f59b8)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:48.712272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:48.764168 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942dbf4686f84d9daa91fc33e38f59b8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:48.776365 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942dbf4686f84d9daa91fc33e38f59b8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:48.777023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942dbf4686f84d9daa91fc33e38f59b8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:48.783993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942dbf4686f84d9daa91fc33e38f59b8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:48.785823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:48.792271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-970fbf10-d08c-40d3-a476-290fa9806e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942dbf4686f84d9daa91fc33e38f59b8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:48.798831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1136/2277] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:09:48 2022] DELETE /identity/v3/users/942dbf4686f84d9daa91fc33e38f59b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:09:48.983035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:48.984531 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:49.001404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c772-4e84-40b6-9cc5-fa4a95ea1650 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.059157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.059787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.060068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.060395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] PATH_INFO: `/v3/projects/fe6b875f365d406694ae4cdf5da2f1fa` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.061552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6b875f365d406694ae4cdf5da2f1fa)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.063450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.101438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:49.114861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6b875f365d406694ae4cdf5da2f1fa', 'request_id': 'req-71fe577d-fd47-4938-857a-e669a3eb4bff'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:49.122577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6b875f365d406694ae4cdf5da2f1fa', 'request_id': 'req-71fe577d-fd47-4938-857a-e669a3eb4bff'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:49.128262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6b875f365d406694ae4cdf5da2f1fa', 'request_id': 'req-71fe577d-fd47-4938-857a-e669a3eb4bff'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:49.139351 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] The token cache is being invalidate because project fe6b875f365d406694ae4cdf5da2f1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:09:49.139642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:49.140271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-71fe577d-fd47-4938-857a-e669a3eb4bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:09:49.141790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1142/2278] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:09:48 2022] DELETE /identity/v3/projects/fe6b875f365d406694ae4cdf5da2f1fa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:09:49.146697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.146998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.147262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.166903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:49.168094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:49.226703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1137/2279] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:49.234196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.234513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.234790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.255145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:49.256354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:49.264196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1143/2280] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:49.268242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.278974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff3f10-fc57-49de-af9d-b1fcc476f34f None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.283580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.284169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.284479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.284750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.285385 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:09:49.285684 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.287251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.299194 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1138/2281] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:09:49.303340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.312428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73f6e-8745-4e0f-841d-1c3e66f0f206 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.317255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.317846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.318125 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.318397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.319157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.321141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.351278 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1144/2282] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:09:49.353152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.363095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b4a3-0e45-4177-88f5-77a82b03548b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.418530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.419117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.419391 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.419659 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.420273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.422202 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.442954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1139/2283] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:09:49 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:09:49.447115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.457464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd1bb-636a-4bdd-ac12-785c930196d7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.462584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.463197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.463474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.463744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.464403 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.466004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.476475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1145/2284] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:09:49.480285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.490453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db171d-4ab4-45c8-b15f-656cefef3a01 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.495093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9976527-371d-40b6-9255-1206b40ff50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.495865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9976527-371d-40b6-9255-1206b40ff50e admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.496152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9976527-371d-40b6-9255-1206b40ff50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.496459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9976527-371d-40b6-9255-1206b40ff50e admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.497097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9976527-371d-40b6-9255-1206b40ff50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.498713 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9976527-371d-40b6-9255-1206b40ff50e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.509289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1140/2285] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:09:49.513262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.523496 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2269fe-c30b-4e98-a7c8-cc1150e40729 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.528044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.528708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.528983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.529249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] PATH_INFO: `/v3/projects/d22c05319d634e05890505b0dbd04ce4/users/3d49e948950c40808e77055fedc5de79/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.544219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22c05319d634e05890505b0dbd04ce4, user_id=3d49e948950c40808e77055fedc5de79, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.546877 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.560594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1146/2286] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:09:49 2022] PUT /identity/v3/projects/d22c05319d634e05890505b0dbd04ce4/users/3d49e948950c40808e77055fedc5de79/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:09:49.565609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f5aa3-fe7d-41d8-8200-736e74c05e41 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.565894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f5aa3-fe7d-41d8-8200-736e74c05e41 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.566167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f5aa3-fe7d-41d8-8200-736e74c05e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.585127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-410f5aa3-fe7d-41d8-8200-736e74c05e41 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:49.586306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-410f5aa3-fe7d-41d8-8200-736e74c05e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:49.635221 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:49.645894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1141/2287] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:49.656141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:49.657873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:49.713885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a249-9deb-4b4f-8656-25a4643e9b05 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:49.717567 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:49.718154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:49.718435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:49.718702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:49.727462 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:49.728906 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:49.738344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1147/2288] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:53.592843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a52ba5-4094-473e-8151-c80779cd6945 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:53.593271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a52ba5-4094-473e-8151-c80779cd6945 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:53.593526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a52ba5-4094-473e-8151-c80779cd6945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:53.625597 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-64a52ba5-4094-473e-8151-c80779cd6945 None None] MFA Rules not processed for user `3d49e948950c40808e77055fedc5de79`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:53.626817 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-64a52ba5-4094-473e-8151-c80779cd6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:53.694259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1142/2289] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:09:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:53.714830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:53.716263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:53.789958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:09:53.807879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5049b64-4646-48b1-9e60-db5a11c3b5ef service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:53.813599 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:53.814176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:53.814570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:53.814852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:53.827918 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:53.829661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:53.839459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1148/2290] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:56.345245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:56.346087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:56.346955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:56.367911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] MFA Rules not processed for user `3d49e948950c40808e77055fedc5de79`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:09:56.369219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:56.376317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1143/2291] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:09:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:09:56.502611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:56.512889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207615a6-4b69-4da5-b55d-dd6a094e3081 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:56.516543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:56.517159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:56.517440 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:56.517722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:56.519547 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:56.534503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:56.535989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ac4b-f494-430c-9552-bb047a65bf96 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:56.548259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1149/2292] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:09:59.096874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:09:59.110265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb570-84ca-44d8-a708-94025f156e4e None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:09:59.115477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:09:59.116261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:09:59.116672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:09:59.117058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:09:59.119032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:09:59.137481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:09:59.139150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:09:59.153614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1144/2293] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:09:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:06.542869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=13 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:08.552510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:08.553095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:08.553095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:08.573210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:08.574405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:08.630112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1150/2294] 10.222.0.49 () {58 vars in 967 bytes} [Wed Oct 26 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:08.678765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:08.680427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:08.751471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4c9e-8743-45d3-ba95-2c40004a407a service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:08.757050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:08.757653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:08.757930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:08.758224 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:08.767182 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:08.768820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:08.777565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1145/2295] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:10:12.072901 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:12.074448 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:12.090651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bd85a-8ff4-44c2-81ca-78ed84582f8c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:12.099823 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:12.100543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:12.100889 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:12.101230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:12.103049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:12.168915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:12.170546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:12.180515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1151/2296] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:16.140453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:16.141886 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:16.156186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6fd8-fad4-4e10-8251-ff394c999d34 service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:16.160884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:16.161628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:16.162019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:16.162411 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] PATH_INFO: `/v3/users/fd7dc257718a407ca0115039514e239b` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:16.163609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7dc257718a407ca0115039514e239b)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:16.165636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:16.212583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7dc257718a407ca0115039514e239b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.216907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:16.226226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7dc257718a407ca0115039514e239b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.226887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7dc257718a407ca0115039514e239b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.233673 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7dc257718a407ca0115039514e239b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.241619 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7dc257718a407ca0115039514e239b'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.247546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1146/2297] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:10:16 2022] DELETE /identity/v3/users/fd7dc257718a407ca0115039514e239b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:16.417736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:16.430677 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65511e-4a0f-4395-bb26-d3b61763320d service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:16.487054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:16.487676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:16.487947 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:16.488232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] PATH_INFO: `/v3/projects/3073e31c4f9f4e88a4843d282c5f289a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:16.489341 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3073e31c4f9f4e88a4843d282c5f289a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:16.491822 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:16.535586 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:16.538968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3073e31c4f9f4e88a4843d282c5f289a', 'request_id': 'req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.545890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3073e31c4f9f4e88a4843d282c5f289a', 'request_id': 'req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.551464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3073e31c4f9f4e88a4843d282c5f289a', 'request_id': 'req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.562739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] The token cache is being invalidate because project 3073e31c4f9f4e88a4843d282c5f289a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:10:16.563022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.563637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.565127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1152/2298] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:10:16 2022] DELETE /identity/v3/projects/3073e31c4f9f4e88a4843d282c5f289a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:16.569738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:16.571144 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:16.583833 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b86810-d8a8-4302-8a42-6619a55782ee admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:16.639111 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:16.639669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:16.639946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:16.640218 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] PATH_INFO: `/v3/users/2e2b4e23e8104e3ca730c92650c79c50` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:16.641359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2b4e23e8104e3ca730c92650c79c50)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:16.643264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:16.687634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2b4e23e8104e3ca730c92650c79c50'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.699233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2b4e23e8104e3ca730c92650c79c50'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.699930 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2b4e23e8104e3ca730c92650c79c50'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.706777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2b4e23e8104e3ca730c92650c79c50'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.713975 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a63d454b-92dc-4c54-b48a-9b10c365f5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2b4e23e8104e3ca730c92650c79c50'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:16.719752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1147/2299] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:10:16 2022] DELETE /identity/v3/users/2e2b4e23e8104e3ca730c92650c79c50 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:16.890502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:16.892024 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:16.906768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ffb7-b0b3-4715-a7a6-f78611f7eb84 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:16.967222 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:16.967958 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:16.968316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:16.968684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] PATH_INFO: `/v3/projects/ec0faa1d2a33423ab240a5c534f8b119` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:16.969801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0faa1d2a33423ab240a5c534f8b119)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:16.971702 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.017992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0faa1d2a33423ab240a5c534f8b119', 'request_id': 'req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:17.025267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0faa1d2a33423ab240a5c534f8b119', 'request_id': 'req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:17.030904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0faa1d2a33423ab240a5c534f8b119', 'request_id': 'req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:17.042492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] The token cache is being invalidate because project ec0faa1d2a33423ab240a5c534f8b119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:10:17.042779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:17.043409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4430f637-d6e0-4d06-82ae-0ac3f5ab21bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:10:17.044927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1153/2300] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:10:16 2022] DELETE /identity/v3/projects/ec0faa1d2a33423ab240a5c534f8b119 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:17.049902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.050262 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.050608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.070112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:17.071351 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:17.116048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:17.133001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1148/2301] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:17.140971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.141198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.141472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.160819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:17.162012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:17.169794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1154/2302] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:17.173814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.183944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7107f62-eedd-4476-a096-d88e6f972286 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.188901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.189501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.189775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.190072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.190709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:10:17.191004 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.192643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.204910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1149/2303] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:10:17.209307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.218472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310d744-a767-4109-ba45-2d8198a8efd7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.223089 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.223686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.223964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.224266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.224938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.226824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.254950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1155/2304] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:17 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:17.259951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.270386 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd269b-1b6b-4e88-a6d2-9dcaaf20494f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.329067 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.329676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.329967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.330266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.330880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.333054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.354520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1150/2305] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:17 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:17.358760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.369805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08249d-0204-4251-a3eb-a59c4e5bb1f1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.374378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.374964 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.375241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.375511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.376138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.377771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.388091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1156/2306] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:17.392114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.401721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61d34-ae7d-4356-b8de-bb5fa5b0fa52 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.407019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af089a-aaf5-4c84-b0b3-49145a497591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.407658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af089a-aaf5-4c84-b0b3-49145a497591 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.407932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af089a-aaf5-4c84-b0b3-49145a497591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.408217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af089a-aaf5-4c84-b0b3-49145a497591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.408866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af089a-aaf5-4c84-b0b3-49145a497591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.410425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af089a-aaf5-4c84-b0b3-49145a497591 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.421409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1151/2307] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:17.425657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.437262 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d8d3-2169-4c92-96b5-31a1f61f78fb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.442277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.442988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.443267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.443538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] PATH_INFO: `/v3/projects/e27d1b8731414ba2841c5f4637c0f75f/users/dc8fbdb556fe40c7bdbb4e21c01e7a35/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.458331 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27d1b8731414ba2841c5f4637c0f75f, user_id=dc8fbdb556fe40c7bdbb4e21c01e7a35, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.461066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.469313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:17.475294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1157/2308] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:17 2022] PUT /identity/v3/projects/e27d1b8731414ba2841c5f4637c0f75f/users/dc8fbdb556fe40c7bdbb4e21c01e7a35/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:17.480417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecf917-5f1c-4487-95fb-ef130eb52eba None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.480707 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecf917-5f1c-4487-95fb-ef130eb52eba None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.480984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecf917-5f1c-4487-95fb-ef130eb52eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.501119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8aecf917-5f1c-4487-95fb-ef130eb52eba None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:17.502333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8aecf917-5f1c-4487-95fb-ef130eb52eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:17.561244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1152/2309] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:17.570967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:17.572711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:17.628508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e2314-11de-4a43-a903-aec7bd04014d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:17.632151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:17.632772 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:17.633051 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:17.633321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:17.642032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:17.643494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:17.652665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1158/2310] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:21.574987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346422b-a44a-4128-b65e-99969c421af4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:21.575962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346422b-a44a-4128-b65e-99969c421af4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:21.576502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346422b-a44a-4128-b65e-99969c421af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:21.599910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8346422b-a44a-4128-b65e-99969c421af4 None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:21.601184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8346422b-a44a-4128-b65e-99969c421af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:21.657395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:21.667630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1153/2311] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:21.681041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:21.682963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:21.770429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b61a-cf4d-48d8-a6e3-fd8b1d8f3130 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:21.776473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:21.777190 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:21.777584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:21.777952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:21.787481 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:21.789267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:21.799056 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1159/2312] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:10:22.123830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.124234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.124628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.171547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] MFA Rules not processed for user `dc8fbdb556fe40c7bdbb4e21c01e7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:22.173450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:22.311420 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1154/2313] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:22.316237 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:22.331274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5491-5ed8-4d72-9674-bd6bb35f2f5c service swift] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:22.340851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:22.342696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.343152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.344698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.345524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:22.348651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:22.392261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1160/2314] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:10:22 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:10:22.397359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:22.409361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c443-4f90-4fed-87c9-854dda7bbc34 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:22.487379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:22.488269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.488663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.489010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.490041 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:22.492461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:22.551292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1155/2315] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:10:22 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:10:22.553419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:22.567570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bf4ae-84f6-4115-9a9c-3847af7993dc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:22.572439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:22.573306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.573761 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.574324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.575836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:22.579580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:22.625219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:22.626180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1161/2316] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:22.642857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b376e49-d775-49e3-a797-37c445ded524 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:22.648744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:22.649939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.650392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.650671 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] PATH_INFO: `/v3/projects/0ec6b4580c20442a8129e86ee78f0368/users/f83b831acc7d44c497d63cf48fd66341/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.671907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec6b4580c20442a8129e86ee78f0368, user_id=f83b831acc7d44c497d63cf48fd66341, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:22.674755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:22.700322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1156/2317] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:22 2022] PUT /identity/v3/projects/0ec6b4580c20442a8129e86ee78f0368/users/f83b831acc7d44c497d63cf48fd66341/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:22.706065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:22.738857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff959e-f854-4f3e-b7e3-d5e894a16184 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:22.836787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8bd1-d67b-4063-950a-5982a7665c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:22.837412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8bd1-d67b-4063-950a-5982a7665c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.837690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8bd1-d67b-4063-950a-5982a7665c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.837962 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8bd1-d67b-4063-950a-5982a7665c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.838626 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8bd1-d67b-4063-950a-5982a7665c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:22.840223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8bd1-d67b-4063-950a-5982a7665c93 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:22.845615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:22.864209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1162/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:10:22.868689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:22.886632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4e9f-4102-4887-bc82-d1f08ac511cd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:22.892473 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:22.893908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:22.894423 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:22.894848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] PATH_INFO: `/v3/projects/0ec6b4580c20442a8129e86ee78f0368/users/f83b831acc7d44c497d63cf48fd66341/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:22.897784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec6b4580c20442a8129e86ee78f0368, user_id=f83b831acc7d44c497d63cf48fd66341, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:22.900913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:22.924104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1157/2319] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:10:22 2022] PUT /identity/v3/projects/0ec6b4580c20442a8129e86ee78f0368/users/f83b831acc7d44c497d63cf48fd66341/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:10:28.830255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662a0d-5966-4429-b20b-ca51a04a1772 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:28.830712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662a0d-5966-4429-b20b-ca51a04a1772 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:28.830970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662a0d-5966-4429-b20b-ca51a04a1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:28.878139 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-df662a0d-5966-4429-b20b-ca51a04a1772 None None] MFA Rules not processed for user `f83b831acc7d44c497d63cf48fd66341`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:28.879502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-df662a0d-5966-4429-b20b-ca51a04a1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:29.029054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1163/2320] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:29.046247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:29.048119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:29.179129 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:29.287476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d814fd5-aec6-414f-85da-87e1c1890913 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:29.309907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:29.310207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:29.310491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:29.310769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:29.457099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:29.458765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:29.469296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1158/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:30.803950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:30.804502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:30.804502 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:30.845517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] MFA Rules not processed for user `dc8fbdb556fe40c7bdbb4e21c01e7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:30.852674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:30.860316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1164/2322] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:35.494739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:35.496252 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:35.558131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2c8e-93e6-493f-b95b-3990775a2f4a service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:35.561832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:35.562435 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:35.562787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:35.563076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:35.564822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:35.575157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:35.576627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:35.585416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1159/2323] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:37.806983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:37.808451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:37.825508 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a495-cb02-4a1c-bc79-bfd13ea3d5f5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:37.831717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:37.832369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:37.833432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:37.833875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:37.835732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:37.849645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:37.851361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4abb19-43d5-4808-af58-4846d7d8b88b service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:37.863397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1165/2324] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:40.418983 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:40.420514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:40.492476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b50c1-b503-464b-8e1b-e750162d3178 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:40.497453 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:40.498051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:40.498330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:40.498604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:40.500322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:40.511541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:40.513141 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:40.523336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1160/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:42.207311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.207778 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.207870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:42.227092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:42.228348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:42.284813 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1166/2326] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Oct 26 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:42.297175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:42.309780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:42.363472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cc80d-f493-4fb7-b99a-06386133c8ea service placement] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:42.369289 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:42.369884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:42.370157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:42.370425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:42.378234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:42.379794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:42.387727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1161/2327] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:10:45.778745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:45.789067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a974f-6a93-4802-8649-271c475e579f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:45.793852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:45.794725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:45.795251 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:45.795747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:45.797747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:45.809162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:45.810620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165cb4-cafa-469f-9f02-3dea7341570e service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:45.818748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1167/2328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:52.384667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=27 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:54.425430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:54.439569 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1816de-88ae-44cd-9c60-12c3a27c8c14 service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:54.448059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:54.448709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:54.448986 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:54.449259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:54.451113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:54.464468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:54.466070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:54.477456 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1162/2329] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:10:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:10:55.815948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=76 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:57.478162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:57.478797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:57.478797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:57.499157 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] MFA Rules not processed for user `4ae3cad6ecec46289d350f4c622442b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:10:57.500376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:10:57.508028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1168/2330] 10.222.0.49 () {58 vars in 967 bytes} [Wed Oct 26 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:10:57.520135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:10:57.532206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93144-9173-4568-b010-ba81a52a0ae9 service nova] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:10:57.538166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98484e9a9d8d41b8ade7fca3f65d10ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:10:57.538774 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:10:57.539048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:10:57.539310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:10:57.548139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:10:57.549744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:10:57.564526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1163/2331] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Oct 26 11:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 26 11:11:02.745622 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:02.754870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271f0d-ee03-49de-870b-b8d8a686464a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:02.758994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:02.759589 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:02.759866 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:02.760135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:02.768885 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:02.770294 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:02.779491 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1169/2332] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:07.555306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=12 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:12.775350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=9 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:38.671618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:38.680863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525ad3-57dc-4632-9255-18422411eed1 service swift] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:38.684389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:38.685003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:38.685281 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:38.685549 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:38.687217 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:38.749399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:38.750853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:38.760902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1164/2333] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:41.924846 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:41.926368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:41.941723 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8404fc1-a222-4267-9c64-7d48497b798f service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:41.948709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:41.948709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:41.948709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:41.948709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] PATH_INFO: `/v3/users/3a46686f6d2444459088c321683566e1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:41.951161 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a46686f6d2444459088c321683566e1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:41.953172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:41.999991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a46686f6d2444459088c321683566e1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.011676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a46686f6d2444459088c321683566e1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.012389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a46686f6d2444459088c321683566e1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.019302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a46686f6d2444459088c321683566e1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.026532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-75d99da1-9bb3-4942-90b2-501fcaf11ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a46686f6d2444459088c321683566e1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.033345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1170/2334] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:11:41 2022] DELETE /identity/v3/users/3a46686f6d2444459088c321683566e1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:42.212662 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.222844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dfa9b-983e-45f5-aad8-c9c0585d0200 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.281313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.281872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.282153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.282427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] PATH_INFO: `/v3/projects/412a39628ce84c2c9b771082117280db` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.283532 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412a39628ce84c2c9b771082117280db)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.285472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.332957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412a39628ce84c2c9b771082117280db', 'request_id': 'req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.340047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412a39628ce84c2c9b771082117280db', 'request_id': 'req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.345645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412a39628ce84c2c9b771082117280db', 'request_id': 'req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.356546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] The token cache is being invalidate because project 412a39628ce84c2c9b771082117280db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:11:42.356829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.357447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2a247c91-d34d-434f-b8e1-ac1fe4e946e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:11:42.359151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1165/2335] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:11:42 2022] DELETE /identity/v3/projects/412a39628ce84c2c9b771082117280db => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:11:42.364859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.365243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.365720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.385700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:42.386894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.445852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1171/2336] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:42.455012 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.455291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.455563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.475644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:42.476970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.484618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1166/2337] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:42.489127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.499352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e856d2-c64b-4470-b53a-569712c335ef None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.503852 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.504471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.504750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.505048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.505689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:11:42.505989 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.507565 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.518810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1172/2338] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:11:42.522958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.531866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eccd2-88bb-4db6-aabe-11f8a2bc6fce None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.536874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.537457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.537731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.537998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.538607 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.540502 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.556222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:42.569784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1167/2339] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:11:42.573914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.583694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33967f1e-931f-4639-ae1b-13035e377256 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.640320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.640941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.641218 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.641486 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.642117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.644012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.651926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:42.665744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1173/2340] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:11:42.675345 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.686249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8fa7f-b05b-4c7c-9e31-4897f1ceb8ac admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.690818 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.691405 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.691683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.691953 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.692667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.694250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.704059 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1168/2341] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:42.708077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.718141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d1d-7153-4f95-859f-6d41ef677ab5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.722645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248667-a0a0-429a-bce1-6eb08827a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.723228 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248667-a0a0-429a-bce1-6eb08827a6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.723503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248667-a0a0-429a-bce1-6eb08827a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.724282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248667-a0a0-429a-bce1-6eb08827a6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.724937 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248667-a0a0-429a-bce1-6eb08827a6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.726511 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248667-a0a0-429a-bce1-6eb08827a6ec admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.737080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1174/2342] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:11:42.741565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.751327 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950d156-b008-44a0-aef6-756917ecc48b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.755860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.756544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.756820 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.757091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] PATH_INFO: `/v3/projects/e276b72d86a94c86a419a49a54363a77/users/1c62cd022bcc4eac9b90cb5e9596a56c/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.771382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e276b72d86a94c86a419a49a54363a77, user_id=1c62cd022bcc4eac9b90cb5e9596a56c, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.774039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.787305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1169/2343] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:11:42 2022] PUT /identity/v3/projects/e276b72d86a94c86a419a49a54363a77/users/1c62cd022bcc4eac9b90cb5e9596a56c/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:11:42.792188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dea45-469a-4e68-bb7b-d4f4aa83f16f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.792505 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dea45-469a-4e68-bb7b-d4f4aa83f16f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.792780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dea45-469a-4e68-bb7b-d4f4aa83f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.812548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4a5dea45-469a-4e68-bb7b-d4f4aa83f16f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:42.813754 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4a5dea45-469a-4e68-bb7b-d4f4aa83f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.872682 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1175/2344] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:42.882311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:42.883960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:42.941596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f47d-1791-4f56-97dc-f103e6ffdda5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:42.945245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:42.945848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:42.946126 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:42.946395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:42.956066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:42.957521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:42.968517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1170/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:46.674458 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81525eb-1f87-475d-9073-88b4b87f70d2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.674985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81525eb-1f87-475d-9073-88b4b87f70d2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.674985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81525eb-1f87-475d-9073-88b4b87f70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.704437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e81525eb-1f87-475d-9073-88b4b87f70d2 None None] MFA Rules not processed for user `1c62cd022bcc4eac9b90cb5e9596a56c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:46.705661 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e81525eb-1f87-475d-9073-88b4b87f70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.783213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1176/2346] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:46.798215 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:11:46.799665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:46.880585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356f74a-fa33-4bf7-95de-e3ace2736a2f service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:11:46.886123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc58d56-627a-4ce0-b663-cc92ca79754f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:11:46.886738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc58d56-627a-4ce0-b663-cc92ca79754f service nova] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:46.887019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc58d56-627a-4ce0-b663-cc92ca79754f service nova] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:46.887293 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc58d56-627a-4ce0-b663-cc92ca79754f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:46.896265 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc58d56-627a-4ce0-b663-cc92ca79754f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:11:46.897902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc58d56-627a-4ce0-b663-cc92ca79754f service nova] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:11:46.908524 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1171/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:48.458882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:11:48.459379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:11:48.459642 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:11:48.479795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] MFA Rules not processed for user `1c62cd022bcc4eac9b90cb5e9596a56c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:11:48.481835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:11:48.492028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1177/2348] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:11:56.906421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:58.473600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:37.955114 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d13db-d445-4d25-8103-2bff2c988088 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:37.955724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d13db-d445-4d25-8103-2bff2c988088 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:37.956003 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d13db-d445-4d25-8103-2bff2c988088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:37.975807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-842d13db-d445-4d25-8103-2bff2c988088 None None] MFA Rules not processed for user `3d49e948950c40808e77055fedc5de79`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:37.977042 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-842d13db-d445-4d25-8103-2bff2c988088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:38.030154 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1172/2349] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:38.330310 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:38.331725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:38.344049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4ce7c-64ca-4b5d-adef-8f276342135d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:38.347607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:38.348201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:38.348585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:38.348861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:38.351156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:38.360562 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:38.362298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:38.370397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1178/2350] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:39.990801 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:39.991353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:39.991353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:40.012183 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] MFA Rules not processed for user `1c62cd022bcc4eac9b90cb5e9596a56c`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:12:40.013746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:40.020668 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1173/2351] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:12:44.165750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:12:44.184617 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5946c-fe9f-409b-bf16-6a0b8b107756 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:12:44.191357 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb82753b2ec4f0b9386b42fd7f69cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:12:44.191966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:12:44.192243 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:12:44.193055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:12:44.194797 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:12:44.207540 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:12:44.209807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae3ef-2917-4e05-8a2d-12760a780e24 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:12:44.220600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1179/2352] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:12:50.006088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=28 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:54.216003 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=12 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:06.715123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:06.716635 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:06.853197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95be2-de1b-4ea4-bd37-76a7368498ee None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:06.858246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:06.858849 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:06.859127 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:06.859395 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:06.861392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:06.872901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:06.874470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705c5bb-969d-4c60-b33c-6bfa59591538 service placement] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:06.884734 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1174/2353] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:15.740034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cfc8c-7989-4983-8a5e-83423780030f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.740627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cfc8c-7989-4983-8a5e-83423780030f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.740627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cfc8c-7989-4983-8a5e-83423780030f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.741926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1180/2354] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:13:15.748186 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224dd35-382e-47ec-92a3-4fc513842d33 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.748684 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224dd35-382e-47ec-92a3-4fc513842d33 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.748790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224dd35-382e-47ec-92a3-4fc513842d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.802060 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2224dd35-382e-47ec-92a3-4fc513842d33 None None] MFA Rules not processed for user `9e032cd87fb84d818b509c5af33716ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:15.803307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2224dd35-382e-47ec-92a3-4fc513842d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:15.819705 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1175/2355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:15.831834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cfc8c-7989-4983-8a5e-83423780030f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:15.843091 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cfc8c-7989-4983-8a5e-83423780030f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:15.847361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa60b7-7881-4db0-b81c-a818a8c93b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:15.848871 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa60b7-7881-4db0-b81c-a818a8c93b7f service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.849354 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa60b7-7881-4db0-b81c-a818a8c93b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.849660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa60b7-7881-4db0-b81c-a818a8c93b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.857529 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa60b7-7881-4db0-b81c-a818a8c93b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:15.858928 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa60b7-7881-4db0-b81c-a818a8c93b7f service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:15.867450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1181/2356] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:15.947530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e30c4-d34e-4144-8354-b0e1ce8cdaae None None] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.947826 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e30c4-d34e-4144-8354-b0e1ce8cdaae None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.948145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e30c4-d34e-4144-8354-b0e1ce8cdaae None None] PATH_INFO: `/` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.949515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1176/2357] 10.222.0.49 () {54 vars in 921 bytes} [Wed Oct 26 11:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 26 11:13:15.954265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204eb2d9-9bf9-47e4-8abf-560945afe951 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:15.954578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204eb2d9-9bf9-47e4-8abf-560945afe951 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:15.954847 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204eb2d9-9bf9-47e4-8abf-560945afe951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:15.987094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-204eb2d9-9bf9-47e4-8abf-560945afe951 None None] MFA Rules not processed for user `ccb82753b2ec4f0b9386b42fd7f69cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:15.988291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-204eb2d9-9bf9-47e4-8abf-560945afe951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:16.012953 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1182/2358] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Oct 26 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:16.023967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e30c4-d34e-4144-8354-b0e1ce8cdaae None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:16.034665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e30c4-d34e-4144-8354-b0e1ce8cdaae None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:16.038721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:16.039307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:16.039585 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:16.039855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:16.049745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:16.051123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:16.061516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1177/2359] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:26.010104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=21 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:26.056899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:41.382021 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:41.382510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:41.382607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:41.402875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] MFA Rules not processed for user `1c62cd022bcc4eac9b90cb5e9596a56c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:41.404074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:41.410854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1183/2360] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:51.397930 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:51.994780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.006615 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e7bea-ebfa-416f-8fa0-b2d76f6ad45b service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.011660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.012233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.012526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.012796 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.014650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:52.026323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.028075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.038579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1178/2361] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:13:52.060590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.063391 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:52.114185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203cae7-f89c-4235-be76-ef59dbadf009 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.119745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.120404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.120680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.120956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] PATH_INFO: `/v3/users/3d49e948950c40808e77055fedc5de79` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.122099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d49e948950c40808e77055fedc5de79)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.124017 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.168862 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d49e948950c40808e77055fedc5de79'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.181231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d49e948950c40808e77055fedc5de79'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.181886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d49e948950c40808e77055fedc5de79'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.188656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d49e948950c40808e77055fedc5de79'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.195641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6af7a1d1-564c-4b5d-98aa-5be1940fcbb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d49e948950c40808e77055fedc5de79'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.201711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1184/2362] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:13:52 2022] DELETE /identity/v3/users/3d49e948950c40808e77055fedc5de79 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:52.371399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.383533 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a382a2-07a0-4db5-b5a8-d9a5eb3d97b8 service placement] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.440235 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.440921 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.441203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.441478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] PATH_INFO: `/v3/projects/d22c05319d634e05890505b0dbd04ce4` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.442608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22c05319d634e05890505b0dbd04ce4)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.445201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.497238 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22c05319d634e05890505b0dbd04ce4', 'request_id': 'req-c7528e31-03ad-4975-9624-01f3e02ea6f1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.504538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22c05319d634e05890505b0dbd04ce4', 'request_id': 'req-c7528e31-03ad-4975-9624-01f3e02ea6f1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.510693 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22c05319d634e05890505b0dbd04ce4', 'request_id': 'req-c7528e31-03ad-4975-9624-01f3e02ea6f1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.522138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] The token cache is being invalidate because project d22c05319d634e05890505b0dbd04ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:13:52.522428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.523053 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c7528e31-03ad-4975-9624-01f3e02ea6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:13:52.524529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1179/2363] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:13:52 2022] DELETE /identity/v3/projects/d22c05319d634e05890505b0dbd04ce4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:52.529523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.530064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.530064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.579033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:52.580263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:52.643836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1185/2364] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:52.651499 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.651813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.652089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.671555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:52.672793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:52.681204 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1180/2365] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:52.685296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.695638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d066b4-1168-46ee-82dc-f570b7c65773 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.700196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.700817 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.701090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.701358 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.701993 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:13:52.702319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.703854 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.715673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1186/2366] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:13:52.719793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.729632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2411b-ad61-4d7c-8e97-99ba4f83e395 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.734288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.734876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.735158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.735433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.736314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.738230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.765612 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1181/2367] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:13:52 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:13:52.769819 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.779935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb242b-2375-4b05-b5d2-b44637784eeb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.784461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:52.840697 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.841205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.841478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.841744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.842356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.844250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.865482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1187/2368] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:13:52 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:13:52.869617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.879841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3b06-d461-41b5-a700-3fabec076133 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.884932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.885522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.885799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.886071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.886700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.888279 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.898631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1182/2369] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:52.902336 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.912112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fa23c-f40f-4ef9-ac26-57e2dc51b1ac admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.916651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd89b-167b-45b3-89dc-ce0733af2279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.917226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd89b-167b-45b3-89dc-ce0733af2279 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.917500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd89b-167b-45b3-89dc-ce0733af2279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.917921 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd89b-167b-45b3-89dc-ce0733af2279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.918977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd89b-167b-45b3-89dc-ce0733af2279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.921940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd89b-167b-45b3-89dc-ce0733af2279 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.934477 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1188/2370] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:13:52.938747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:52.949609 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f84acd-c5dc-49dc-aa68-a35b899a46b2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:52.954335 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:52.954969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:52.955326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:52.955517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] PATH_INFO: `/v3/projects/f643f0b6848b4274887f898373c37b55/users/90981e64c88d46dda46eaf3ff699ba76/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:52.972063 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f643f0b6848b4274887f898373c37b55, user_id=90981e64c88d46dda46eaf3ff699ba76, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:52.974773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:52.999832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1183/2371] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:13:52 2022] PUT /identity/v3/projects/f643f0b6848b4274887f898373c37b55/users/90981e64c88d46dda46eaf3ff699ba76/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:13:53.002664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91553943-7934-437c-b85e-6da46d26e066 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:53.002935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91553943-7934-437c-b85e-6da46d26e066 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:53.003209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91553943-7934-437c-b85e-6da46d26e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:53.038700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-91553943-7934-437c-b85e-6da46d26e066 None None] MFA Rules not processed for user `90981e64c88d46dda46eaf3ff699ba76`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:13:53.039948 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-91553943-7934-437c-b85e-6da46d26e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:53.118066 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1189/2372] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:13:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:13:53.129009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:13:53.130718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:13:53.151191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:13:53.215417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab523fb-cffc-4df4-bae4-45ee059a5f5e admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:13:53.219145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279fe15-803c-4c28-afed-e05230c62981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:13:53.219752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279fe15-803c-4c28-afed-e05230c62981 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:13:53.220027 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279fe15-803c-4c28-afed-e05230c62981 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:13:53.220300 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279fe15-803c-4c28-afed-e05230c62981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:13:53.228888 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279fe15-803c-4c28-afed-e05230c62981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:13:53.230326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279fe15-803c-4c28-afed-e05230c62981 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:13:53.239709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1184/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:13:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:01.639942 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91553943-7934-437c-b85e-6da46d26e066 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:01.700461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91553943-7934-437c-b85e-6da46d26e066 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:01.704912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:01.705527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:01.705800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:01.706070 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] PATH_INFO: `/v3/users/90981e64c88d46dda46eaf3ff699ba76` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:01.707156 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90981e64c88d46dda46eaf3ff699ba76)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:01.709086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:01.729653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:01.757777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90981e64c88d46dda46eaf3ff699ba76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:01.769381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90981e64c88d46dda46eaf3ff699ba76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:01.770043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90981e64c88d46dda46eaf3ff699ba76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:01.776863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90981e64c88d46dda46eaf3ff699ba76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:01.783777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90981e64c88d46dda46eaf3ff699ba76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:01.790202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1190/2374] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:01 2022] DELETE /identity/v3/users/90981e64c88d46dda46eaf3ff699ba76 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:01.794891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:01.795394 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:01.795510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:01.814984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:01.816175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:01.874754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1185/2375] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:01.885503 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:01.886832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:01.942611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a93a1f-d954-44a8-8f3d-2b97b1add028 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:01.946625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a2d36-41b4-47ac-b2bb-dcf20e8fa719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:01.947229 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a2d36-41b4-47ac-b2bb-dcf20e8fa719 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:01.947507 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a2d36-41b4-47ac-b2bb-dcf20e8fa719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:01.947780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a2d36-41b4-47ac-b2bb-dcf20e8fa719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:01.957094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a2d36-41b4-47ac-b2bb-dcf20e8fa719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:01.958515 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a2d36-41b4-47ac-b2bb-dcf20e8fa719 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:01.967971 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1191/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:02.230307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.231850 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:02.245665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5229-4465-4760-8afe-deffd9229554 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.250278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.250991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.251275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.251543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] PATH_INFO: `/v3/projects/f643f0b6848b4274887f898373c37b55` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.252681 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f643f0b6848b4274887f898373c37b55)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.254573 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.301721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f643f0b6848b4274887f898373c37b55', 'request_id': 'req-606a2007-4129-4e64-a71a-9b114d055b45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:02.308701 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f643f0b6848b4274887f898373c37b55', 'request_id': 'req-606a2007-4129-4e64-a71a-9b114d055b45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:02.314416 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f643f0b6848b4274887f898373c37b55', 'request_id': 'req-606a2007-4129-4e64-a71a-9b114d055b45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:02.325727 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] The token cache is being invalidate because project f643f0b6848b4274887f898373c37b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:02.326016 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:02.326644 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-606a2007-4129-4e64-a71a-9b114d055b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:02.328160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1186/2377] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:02 2022] DELETE /identity/v3/projects/f643f0b6848b4274887f898373c37b55 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:02.333032 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.333321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.333598 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.354361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:02.355580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:02.414043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1192/2378] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:02.421807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.422117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.422540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.441934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:02.443130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:02.451056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1187/2379] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:02.455203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.465198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348deb9e-8441-4644-a509-ce7b1179fcc0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.469693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.470274 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.470546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.470811 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.471438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:14:02.471759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.473362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.485171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1193/2380] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:14:02.489722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.498940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968fe7c-ca24-4c92-a937-54ba14492e22 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.503554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.504149 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.504472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.504747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.505366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.507307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.518409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:02.535812 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1188/2381] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:02.540635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.550734 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9563-7c4a-4b9f-a34c-d68eae7e156e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.574874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:02.607541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.608163 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.608472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.608745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.609373 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.611546 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.633283 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1194/2382] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:02.637438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.648086 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e1b4-f13f-46f6-bcec-5304cd7ea0d8 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.653013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.653599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.653874 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.654190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.654811 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.656401 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.666152 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1189/2383] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:14:02.669920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.679831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902648-9627-48a6-8b85-8220e762285a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.684482 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278229ed-b0e6-4f82-9520-14221fb4d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.685111 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278229ed-b0e6-4f82-9520-14221fb4d2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.685390 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278229ed-b0e6-4f82-9520-14221fb4d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.685660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278229ed-b0e6-4f82-9520-14221fb4d2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.686296 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278229ed-b0e6-4f82-9520-14221fb4d2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.687860 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278229ed-b0e6-4f82-9520-14221fb4d2b3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.698732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1195/2384] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:02.702627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.712946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc835-2bd5-4778-a064-4f441d97040c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.717498 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.718123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.718396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.718661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] PATH_INFO: `/v3/projects/8f246e6f99cf4863ab5223cfa48e722a/users/168719bd8d6a4a9daa82e9709c163991/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.732868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f246e6f99cf4863ab5223cfa48e722a, user_id=168719bd8d6a4a9daa82e9709c163991, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.735815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.749376 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1190/2385] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:02 2022] PUT /identity/v3/projects/8f246e6f99cf4863ab5223cfa48e722a/users/168719bd8d6a4a9daa82e9709c163991/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:02.761369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.761655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.761945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.790745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] MFA Rules not processed for user `168719bd8d6a4a9daa82e9709c163991`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:02.791938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:02.854270 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1196/2386] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:02.858922 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.919047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421019-66aa-4f56-8f4b-889075e67ec1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:02.923539 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:02.924125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:02.924441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:02.924717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:02.925331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:02.927216 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:02.953589 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1191/2387] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/projects => generated 403 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:02.957759 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:02.968113 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a23b2-ddff-4a8d-9d1e-aa4bbe59d0ae None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.023005 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.023604 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.023880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.024150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.024806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.026713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.047372 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1197/2388] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:02 2022] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:03.051359 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.062034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e963-8fd8-44ec-a1ea-1b6d93db9de0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.066605 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.067195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.067487 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.067741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.068402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.070535 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.081131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1192/2389] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:03.085321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.095287 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312319e-9f70-4376-8313-c8058e0e3436 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.099972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.100659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.100934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.101206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] PATH_INFO: `/v3/projects/bca759ef95c34107b59ad99625f1e0e2/users/72493542b7b44231a393ce4712c9483e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.116742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca759ef95c34107b59ad99625f1e0e2, user_id=72493542b7b44231a393ce4712c9483e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.119412 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.128226 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:03.133859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1198/2390] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:03 2022] PUT /identity/v3/projects/bca759ef95c34107b59ad99625f1e0e2/users/72493542b7b44231a393ce4712c9483e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:03.137991 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.147866 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9f458-0a54-40a1-9ddd-03bfec51ef24 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.202731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f584319-4f70-4490-aee9-fa3b5ae7ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.203263 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f584319-4f70-4490-aee9-fa3b5ae7ced6 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.203543 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f584319-4f70-4490-aee9-fa3b5ae7ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.203840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f584319-4f70-4490-aee9-fa3b5ae7ced6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.204506 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f584319-4f70-4490-aee9-fa3b5ae7ced6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.206200 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f584319-4f70-4490-aee9-fa3b5ae7ced6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.216268 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1193/2391] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:03.220401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.230469 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e414c-9096-4f14-8b86-acd2783a8ea4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.234956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.235859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.236133 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.236438 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] PATH_INFO: `/v3/projects/bca759ef95c34107b59ad99625f1e0e2/users/72493542b7b44231a393ce4712c9483e/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.238331 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca759ef95c34107b59ad99625f1e0e2, user_id=72493542b7b44231a393ce4712c9483e, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.241551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.251504 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1199/2392] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:03 2022] PUT /identity/v3/projects/bca759ef95c34107b59ad99625f1e0e2/users/72493542b7b44231a393ce4712c9483e/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:03.262145 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.262438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.262717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.290377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] MFA Rules not processed for user `72493542b7b44231a393ce4712c9483e`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:03.291583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:03.304389 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:03.364777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1194/2393] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:03.376033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.377773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:03.433872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5f9b-a366-41b9-a66d-1c616ca28d4e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.437468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175692-02aa-467f-a4c8-94733265525f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.438055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175692-02aa-467f-a4c8-94733265525f service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.438333 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175692-02aa-467f-a4c8-94733265525f service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.438609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175692-02aa-467f-a4c8-94733265525f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.447275 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175692-02aa-467f-a4c8-94733265525f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.448721 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175692-02aa-467f-a4c8-94733265525f service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.457894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1200/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:03 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:03.590879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.652219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8757d0-d23d-49c9-9b8e-aef4c0626b42 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.656823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.657478 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.657757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.658030 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] PATH_INFO: `/v3/users/168719bd8d6a4a9daa82e9709c163991` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.659160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=168719bd8d6a4a9daa82e9709c163991)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.661115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.706021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168719bd8d6a4a9daa82e9709c163991'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:03.718210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168719bd8d6a4a9daa82e9709c163991'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:03.718808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168719bd8d6a4a9daa82e9709c163991'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:03.726233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168719bd8d6a4a9daa82e9709c163991'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:03.733106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168719bd8d6a4a9daa82e9709c163991'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:03.739165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1195/2395] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:03 2022] DELETE /identity/v3/users/168719bd8d6a4a9daa82e9709c163991 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:03.743804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.744292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.744436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.762952 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:03.764142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:03.820688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1201/2396] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:03.830337 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:03.831779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:03.868275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:03.892314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ebe8-13cb-4402-bab8-daa12c2d53ce admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:03.895891 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:03.896515 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:03.896790 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:03.897630 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:03.906318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:03.907735 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:03.917419 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1196/2397] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:04.184557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:04.186031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:04.201225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6efcb-6071-435f-b64b-c087ea578d17 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:04.205979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:04.207178 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:04.207555 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:04.208039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] PATH_INFO: `/v3/projects/8f246e6f99cf4863ab5223cfa48e722a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:04.209269 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f246e6f99cf4863ab5223cfa48e722a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:04.211839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:04.259210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f246e6f99cf4863ab5223cfa48e722a', 'request_id': 'req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.266359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f246e6f99cf4863ab5223cfa48e722a', 'request_id': 'req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.271884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f246e6f99cf4863ab5223cfa48e722a', 'request_id': 'req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.283392 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] The token cache is being invalidate because project 8f246e6f99cf4863ab5223cfa48e722a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:04.283674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.284299 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.285800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1202/2398] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:04 2022] DELETE /identity/v3/projects/8f246e6f99cf4863ab5223cfa48e722a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:04.289865 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:04.299418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446665d-65f6-4ac9-a28f-1a25d4bf4801 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:04.354333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:04.354948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:04.355223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:04.355490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] PATH_INFO: `/v3/users/72493542b7b44231a393ce4712c9483e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:04.356621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72493542b7b44231a393ce4712c9483e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:04.358640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:04.403023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72493542b7b44231a393ce4712c9483e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.414449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72493542b7b44231a393ce4712c9483e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.415087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72493542b7b44231a393ce4712c9483e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.421992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72493542b7b44231a393ce4712c9483e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.429082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d3e65a4a-1024-4c86-8ae3-adeb389b5052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72493542b7b44231a393ce4712c9483e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.435101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1197/2399] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:04 2022] DELETE /identity/v3/users/72493542b7b44231a393ce4712c9483e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:04.702552 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:04.703992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:04.717564 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f0e6-e185-4fc0-9c1a-a93e1824762c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:04.727377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:04.778991 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:04.779696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:04.779890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:04.780159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] PATH_INFO: `/v3/projects/bca759ef95c34107b59ad99625f1e0e2` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:04.781393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca759ef95c34107b59ad99625f1e0e2)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:04.783316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:04.828835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca759ef95c34107b59ad99625f1e0e2', 'request_id': 'req-b8986c37-f7a1-4b51-8023-24e6b63a5157'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.836063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca759ef95c34107b59ad99625f1e0e2', 'request_id': 'req-b8986c37-f7a1-4b51-8023-24e6b63a5157'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.841752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca759ef95c34107b59ad99625f1e0e2', 'request_id': 'req-b8986c37-f7a1-4b51-8023-24e6b63a5157'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.856956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] The token cache is being invalidate because project bca759ef95c34107b59ad99625f1e0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:04.857245 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.857894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8986c37-f7a1-4b51-8023-24e6b63a5157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:04.859409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1203/2400] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:04 2022] DELETE /identity/v3/projects/bca759ef95c34107b59ad99625f1e0e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:04.864557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:04.864848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:04.865125 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:04.886205 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:04.887398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:04.933981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:04.948287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1198/2401] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:14:04.956121 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:04.956437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:04.956713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:04.976919 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:04.978147 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:04.986499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1204/2402] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:14:04.990575 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.002683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcccba-9584-4e4b-8ab1-02e73ef4e050 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.007620 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.008309 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.008636 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.008906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.009546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:14:05.009844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.011938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.023762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1199/2403] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:14:05.028086 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.037307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dec932-b6b2-45f9-b130-c1c99159224c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.042535 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.043135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.043413 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.043689 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.044376 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.046272 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.074883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1205/2404] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:05 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:05.078797 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.088878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457036b8-2f32-41c9-ba53-5a5024a2202a admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.145087 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.145667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.145943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.146211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.146832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.149307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.170079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1200/2405] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:05 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:05.174159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.184241 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4af4-0d41-4676-9c18-e927206c520a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.188880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.189466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.189742 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.190011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.190641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.192213 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.202067 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1206/2406] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:05.205940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.216212 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1238b-3772-4548-8ee6-e766f23ae826 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.220762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461db25-797c-4bcd-b1c2-4337d35cbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.221344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461db25-797c-4bcd-b1c2-4337d35cbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.221624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461db25-797c-4bcd-b1c2-4337d35cbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.221895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461db25-797c-4bcd-b1c2-4337d35cbe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.222523 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461db25-797c-4bcd-b1c2-4337d35cbe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.224078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461db25-797c-4bcd-b1c2-4337d35cbe2a admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.235050 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1201/2407] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:05.239219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.249155 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56addfcb-2296-418a-a0ec-c0f91d0dd85e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.253735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.254369 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.254643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.254910 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] PATH_INFO: `/v3/projects/e45d81a067694151b2496d3c846427c9/users/793099e6ec7243a894b5e77e27649f20/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.269708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45d81a067694151b2496d3c846427c9, user_id=793099e6ec7243a894b5e77e27649f20, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.272987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.285447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1207/2408] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:05 2022] PUT /identity/v3/projects/e45d81a067694151b2496d3c846427c9/users/793099e6ec7243a894b5e77e27649f20/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:05.291093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64813e-e4ca-406f-a25a-580e1a06a210 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.291378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64813e-e4ca-406f-a25a-580e1a06a210 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.291650 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64813e-e4ca-406f-a25a-580e1a06a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.310123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ac64813e-e4ca-406f-a25a-580e1a06a210 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:05.311313 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ac64813e-e4ca-406f-a25a-580e1a06a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:05.369171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1202/2409] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:05.378632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:05.380328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:05.423464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:05.438201 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547dd0-3181-4618-8a6a-51af96784e61 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:05.441781 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:05.442379 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:05.442656 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:05.442927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:05.451772 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:05.453225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:05.464238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1208/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:06.283290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.283800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.283900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.312241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] MFA Rules not processed for user `793099e6ec7243a894b5e77e27649f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:06.313495 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:06.363894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:06.394433 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1203/2411] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:06.399145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.408998 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa80b-0753-49de-96fa-70d629cb64df service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.414569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.414736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.414973 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.415242 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.415868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.417800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.446651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1209/2412] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:06 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:14:06.450733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.463117 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6830c-72c0-45db-8e3c-c7bc11655e7c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.519631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.520233 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.520564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.520840 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.521460 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.523468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.544885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1204/2413] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:06 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:06.549054 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.559767 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990771-1f5a-4f6e-9bb8-c1aea0514cad admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.564308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.564924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.565204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.565478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.566117 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.567696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.578315 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1210/2414] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:06.582076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.592755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca85f9-7279-45a1-8c96-2612ebad8998 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.597402 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.598047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.598330 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.598603 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] PATH_INFO: `/v3/projects/270ced0b0f37447c9329f30638bd6828/users/dd4bbc8d649a4d9081a3987415ef7d93/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.614120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270ced0b0f37447c9329f30638bd6828, user_id=dd4bbc8d649a4d9081a3987415ef7d93, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.617353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.630346 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1205/2415] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:06 2022] PUT /identity/v3/projects/270ced0b0f37447c9329f30638bd6828/users/dd4bbc8d649a4d9081a3987415ef7d93/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:14:06.634492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.644432 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219b839-8d7f-4ad9-bf2e-da27eeae4b83 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.701941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b7f8e-7803-4709-a175-2c1babf1a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.702542 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b7f8e-7803-4709-a175-2c1babf1a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.702816 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b7f8e-7803-4709-a175-2c1babf1a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.703080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b7f8e-7803-4709-a175-2c1babf1a9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.703703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b7f8e-7803-4709-a175-2c1babf1a9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.705304 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b7f8e-7803-4709-a175-2c1babf1a9e9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.719284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1211/2416] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:06.720520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:06.731731 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386cfef-92ee-4dce-b1e6-0fce992ed913 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:06.736844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:06.737493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:06.737769 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:06.738099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] PATH_INFO: `/v3/projects/270ced0b0f37447c9329f30638bd6828/users/dd4bbc8d649a4d9081a3987415ef7d93/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:06.739999 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270ced0b0f37447c9329f30638bd6828, user_id=dd4bbc8d649a4d9081a3987415ef7d93, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:06.742927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:06.754102 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1206/2417] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:06 2022] PUT /identity/v3/projects/270ced0b0f37447c9329f30638bd6828/users/dd4bbc8d649a4d9081a3987415ef7d93/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:07.385095 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:07.385404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:07.385735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:07.414494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] MFA Rules not processed for user `dd4bbc8d649a4d9081a3987415ef7d93`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:07.415615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:07.492894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1212/2418] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:08.433310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:08.435054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:08.494317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:08.511878 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c46eb-33a1-459a-8940-5ac41193f541 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:08.517490 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:08.518094 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:08.518368 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:08.518637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:08.520687 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:08.532287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:08.533879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:08.534042 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:08.545195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1207/2419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:08.567629 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b6eb-d262-4863-a815-cdd8adf3d547 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:08.572254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:08.572914 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:08.573305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:08.573579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] PATH_INFO: `/v3/users/793099e6ec7243a894b5e77e27649f20` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:08.574700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] RBAC: Authorizing `identity:delete_user(user_id=793099e6ec7243a894b5e77e27649f20)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:08.576751 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:08.623457 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793099e6ec7243a894b5e77e27649f20'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.634979 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793099e6ec7243a894b5e77e27649f20'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.635636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793099e6ec7243a894b5e77e27649f20'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.642422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793099e6ec7243a894b5e77e27649f20'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.649654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793099e6ec7243a894b5e77e27649f20'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.655700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1213/2420] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:08 2022] DELETE /identity/v3/users/793099e6ec7243a894b5e77e27649f20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:14:08.825663 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:08.836933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168b83-1950-4ac8-9a19-e2e4e6b409a7 service placement] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:08.870162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:08.899257 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:08.899883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:08.900162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:08.900472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] PATH_INFO: `/v3/projects/e45d81a067694151b2496d3c846427c9` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:08.901576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45d81a067694151b2496d3c846427c9)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:08.903467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:08.947708 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45d81a067694151b2496d3c846427c9', 'request_id': 'req-aec6c63e-91d6-4f04-a77c-a0fcee535b62'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.954813 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45d81a067694151b2496d3c846427c9', 'request_id': 'req-aec6c63e-91d6-4f04-a77c-a0fcee535b62'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.960982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45d81a067694151b2496d3c846427c9', 'request_id': 'req-aec6c63e-91d6-4f04-a77c-a0fcee535b62'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.971981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] The token cache is being invalidate because project e45d81a067694151b2496d3c846427c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:08.972272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.972967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:08.974505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1208/2421] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:08 2022] DELETE /identity/v3/projects/e45d81a067694151b2496d3c846427c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:08.979279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:08.980815 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:08.993867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256278cf-8fb8-4960-b41d-2bde069d278e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.053518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.054061 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.054343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.054611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] PATH_INFO: `/v3/users/dd4bbc8d649a4d9081a3987415ef7d93` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.055731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4bbc8d649a4d9081a3987415ef7d93)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.057673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.109404 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4bbc8d649a4d9081a3987415ef7d93'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.114088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:09.122904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4bbc8d649a4d9081a3987415ef7d93'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.123653 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4bbc8d649a4d9081a3987415ef7d93'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.130896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4bbc8d649a4d9081a3987415ef7d93'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.137832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0e9eee1d-08af-4bd6-a13d-ea10bc10d9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4bbc8d649a4d9081a3987415ef7d93'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.143601 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1214/2422] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:08 2022] DELETE /identity/v3/users/dd4bbc8d649a4d9081a3987415ef7d93 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:09.312775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.314301 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:09.327631 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c63e-91d6-4f04-a77c-a0fcee535b62 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.386560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.387191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.387468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.387738 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] PATH_INFO: `/v3/projects/270ced0b0f37447c9329f30638bd6828` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.388889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270ced0b0f37447c9329f30638bd6828)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.390823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.435621 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270ced0b0f37447c9329f30638bd6828', 'request_id': 'req-f1ad27df-aeea-4333-9341-b6d9472e2fe8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.442371 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270ced0b0f37447c9329f30638bd6828', 'request_id': 'req-f1ad27df-aeea-4333-9341-b6d9472e2fe8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.447510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:09.448793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270ced0b0f37447c9329f30638bd6828', 'request_id': 'req-f1ad27df-aeea-4333-9341-b6d9472e2fe8'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.462201 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] The token cache is being invalidate because project 270ced0b0f37447c9329f30638bd6828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:09.462488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.463118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-f1ad27df-aeea-4333-9341-b6d9472e2fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:09.464618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1209/2423] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:09 2022] DELETE /identity/v3/projects/270ced0b0f37447c9329f30638bd6828 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:09.469517 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.469805 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.470082 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.489580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:09.490775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:09.549265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1215/2424] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:09.557336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.557557 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.557829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.578009 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:09.579223 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:09.587877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1210/2425] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:09.591916 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.601532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec781f2-d27f-4861-aa8f-3dc1c16406a3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.606045 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.606635 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.606908 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.607179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.607812 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:14:09.608112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.609736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.622824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1216/2426] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:14:09.627064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.636838 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0afe24-bdfd-43b4-a255-26ff8eda7226 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.641379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.641965 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.642240 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.642505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.643113 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.645049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.670753 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1211/2427] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:09 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:09.674896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.685152 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680811f-a6e8-40ad-8a09-8dcd5a4ff822 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.739574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.740175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.740528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.740801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.741433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.743841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.765307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1217/2428] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:09 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:14:09.769481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.779608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699a1a-6d72-47c9-a8fc-006c2e772f44 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.784277 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.784897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.785177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.785450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.786090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.787669 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.797388 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1212/2429] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:09.801211 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.811575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315f88-63cc-47ac-83ec-b9ea4209da2a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.816118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a858a-e9da-42e1-a242-c14cc53da284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.816755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a858a-e9da-42e1-a242-c14cc53da284 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.817033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a858a-e9da-42e1-a242-c14cc53da284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.817308 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a858a-e9da-42e1-a242-c14cc53da284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.817941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a858a-e9da-42e1-a242-c14cc53da284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.819514 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a858a-e9da-42e1-a242-c14cc53da284 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.830466 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1218/2430] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:09.834349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:09.844193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5bd18-11e1-48fc-bc41-c083f65c4492 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:09.848853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:09.849561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.849867 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.850179 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] PATH_INFO: `/v3/projects/b18a80aef5df4107845ff2974b8f0015/users/f775fa7f84114c99a090122c41cd31b1/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.867700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18a80aef5df4107845ff2974b8f0015, user_id=f775fa7f84114c99a090122c41cd31b1, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:09.870438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:09.883203 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1213/2431] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:09 2022] PUT /identity/v3/projects/b18a80aef5df4107845ff2974b8f0015/users/f775fa7f84114c99a090122c41cd31b1/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:09.946013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:09.946267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:09.946536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:09.974010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] MFA Rules not processed for user `f775fa7f84114c99a090122c41cd31b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:09.975224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:09.999363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:10.039904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1219/2432] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:10.044318 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.106803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69122037-ea31-4e72-a1d2-c04429e9ef3d admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.111723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.112322 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.112628 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.112900 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.113519 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.115538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.142906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1214/2433] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:10 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:10.146875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.157623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b5ce-644f-436d-9897-f0af04abe420 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.213490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.214087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.214361 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.214630 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.215252 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.217185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.238968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1220/2434] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:10 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:10.243542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.253555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599394e-6c30-4a22-b547-f7a1218d23ed admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.258493 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.259075 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.259348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.259614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.260237 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.261844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.272239 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1215/2435] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:10.276290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.286311 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b694c3-80d4-45cd-a101-381056d01e33 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.291445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.292083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.292385 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.292663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] PATH_INFO: `/v3/projects/387c3290246c4923b47b77890b10335e/users/0f9f390919c34e8faf1d9b57e983b5c9/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.307560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=387c3290246c4923b47b77890b10335e, user_id=0f9f390919c34e8faf1d9b57e983b5c9, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.310259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.322924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1221/2436] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:10 2022] PUT /identity/v3/projects/387c3290246c4923b47b77890b10335e/users/0f9f390919c34e8faf1d9b57e983b5c9/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 26 11:14:10.326815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.336554 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fa87f-4c8e-48d4-9724-62866e3f8482 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.392580 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb222-cea3-4fbe-89c6-8449eb4cfd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.393098 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb222-cea3-4fbe-89c6-8449eb4cfd98 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.393372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb222-cea3-4fbe-89c6-8449eb4cfd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.393640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb222-cea3-4fbe-89c6-8449eb4cfd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.394254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb222-cea3-4fbe-89c6-8449eb4cfd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.395822 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb222-cea3-4fbe-89c6-8449eb4cfd98 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.397807 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:10.407563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1216/2437] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:10.411603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.422645 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d738fc-8b41-4a2c-ae5a-ad3b80de2b0b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.427200 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.427841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.428116 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.428428 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] PATH_INFO: `/v3/projects/387c3290246c4923b47b77890b10335e/users/0f9f390919c34e8faf1d9b57e983b5c9/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.430324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=387c3290246c4923b47b77890b10335e, user_id=0f9f390919c34e8faf1d9b57e983b5c9, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.432968 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.443033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1222/2438] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:10 2022] PUT /identity/v3/projects/387c3290246c4923b47b77890b10335e/users/0f9f390919c34e8faf1d9b57e983b5c9/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:10.452977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.453492 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.453618 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.483134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] MFA Rules not processed for user `0f9f390919c34e8faf1d9b57e983b5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:10.484413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:10.551206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1217/2439] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:10.562340 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.564074 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:10.621638 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093df3b-3e7e-4794-bac1-5d7985fab0fe admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.625271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.625864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.626141 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.626414 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.635377 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.636851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.646186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1223/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:10.720737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:10.731744 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e6cfc-7732-4a2e-a131-3f572755b333 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:10.735775 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493db30-874d-46d7-a6a0-2db0d66040f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:10.736425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493db30-874d-46d7-a6a0-2db0d66040f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:10.736728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493db30-874d-46d7-a6a0-2db0d66040f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:10.736998 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493db30-874d-46d7-a6a0-2db0d66040f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:10.797019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493db30-874d-46d7-a6a0-2db0d66040f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:10.811857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493db30-874d-46d7-a6a0-2db0d66040f2 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:10.811857 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1218/2441] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:17.579553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:17.600276 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:17.641954 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7e951-edc7-4094-93fa-26ab1cf87a3a service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:17.646706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:17.647383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:17.647698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:17.648499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] PATH_INFO: `/v3/users/f775fa7f84114c99a090122c41cd31b1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:17.649680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f775fa7f84114c99a090122c41cd31b1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:17.651614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:17.697842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f775fa7f84114c99a090122c41cd31b1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:17.709219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f775fa7f84114c99a090122c41cd31b1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:17.709875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f775fa7f84114c99a090122c41cd31b1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:17.717203 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f775fa7f84114c99a090122c41cd31b1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:17.724063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f775fa7f84114c99a090122c41cd31b1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:17.729826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1224/2442] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:17 2022] DELETE /identity/v3/users/f775fa7f84114c99a090122c41cd31b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:17.734278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:17.734757 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:17.734876 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:17.753969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:17.755173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:17.812670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1219/2443] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:17.822842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:17.824230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:17.881473 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f1301-2449-49fa-a787-d2eae498ed9b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:17.885880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:17.886472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:17.886752 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:17.887040 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:17.895972 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:17.897433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:17.906746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1225/2444] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:18.174466 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:18.176177 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:18.190819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e1405-efe9-42bc-800a-6b7a9415143c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:18.195526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:18.196158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.196470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.196747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] PATH_INFO: `/v3/projects/b18a80aef5df4107845ff2974b8f0015` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.197877 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18a80aef5df4107845ff2974b8f0015)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:18.199785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:18.217323 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=100 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:18.246710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18a80aef5df4107845ff2974b8f0015', 'request_id': 'req-76f99229-9478-42ea-bf53-70e7f03fdb35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.253242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18a80aef5df4107845ff2974b8f0015', 'request_id': 'req-76f99229-9478-42ea-bf53-70e7f03fdb35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.259130 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18a80aef5df4107845ff2974b8f0015', 'request_id': 'req-76f99229-9478-42ea-bf53-70e7f03fdb35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.270106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] The token cache is being invalidate because project b18a80aef5df4107845ff2974b8f0015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:18.270397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.271032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.273160 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1220/2445] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:18 2022] DELETE /identity/v3/projects/b18a80aef5df4107845ff2974b8f0015 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:18.277120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:18.286649 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8fcfe-39f3-4262-965d-3d2c52942c30 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:18.326538 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:18.344452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:18.345202 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.345484 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.345762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] PATH_INFO: `/v3/users/0f9f390919c34e8faf1d9b57e983b5c9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.346875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9f390919c34e8faf1d9b57e983b5c9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:18.348814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:18.393704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9f390919c34e8faf1d9b57e983b5c9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.405695 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9f390919c34e8faf1d9b57e983b5c9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.406321 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9f390919c34e8faf1d9b57e983b5c9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.413015 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9f390919c34e8faf1d9b57e983b5c9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.420010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-26cedc29-e626-4913-ac32-8615045abc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9f390919c34e8faf1d9b57e983b5c9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.425703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1226/2446] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:18 2022] DELETE /identity/v3/users/0f9f390919c34e8faf1d9b57e983b5c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:18.690380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:18.691836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:18.705285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99229-9478-42ea-bf53-70e7f03fdb35 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:18.763617 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:18.764256 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.764536 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.764806 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] PATH_INFO: `/v3/projects/387c3290246c4923b47b77890b10335e` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.765893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=387c3290246c4923b47b77890b10335e)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:18.767781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:18.813595 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387c3290246c4923b47b77890b10335e', 'request_id': 'req-5eb9f678-9643-4d2b-b44b-402038ea8e7d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.820544 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387c3290246c4923b47b77890b10335e', 'request_id': 'req-5eb9f678-9643-4d2b-b44b-402038ea8e7d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.826248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387c3290246c4923b47b77890b10335e', 'request_id': 'req-5eb9f678-9643-4d2b-b44b-402038ea8e7d'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.838173 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] The token cache is being invalidate because project 387c3290246c4923b47b77890b10335e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:18.838461 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.839091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-5eb9f678-9643-4d2b-b44b-402038ea8e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:18.840587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1221/2447] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:18 2022] DELETE /identity/v3/projects/387c3290246c4923b47b77890b10335e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:18.845536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.846004 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.846103 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.866690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:18.867892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:18.929891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1227/2448] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:18.939193 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.939475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.939748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.959261 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:18.961272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:18.969633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1222/2449] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:18.973534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:18.983949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40385e31-56d5-4220-9a17-01c99a058506 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:18.988803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:18.989389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:18.989668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:18.989935 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:18.990569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:14:18.990868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:18.992631 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.004206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1228/2450] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:14:19.009043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.019043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c46c-1fbc-4cb8-acec-73a8dcef17c0 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.024431 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.025151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.025512 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.025880 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.026614 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.028889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.058561 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1223/2451] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:19 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:14:19.062701 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.073615 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780823d-f8ba-475b-abdc-e6e295be2e79 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.119356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:19.133058 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.133664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.133941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.134212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.134832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.136784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.158800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1229/2452] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:19 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:19.162985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.174397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228570a0-4264-469f-bf73-886bfdeeb721 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.179029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.179666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.179889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.180156 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.180829 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.182525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.183846 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:19.197444 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1224/2453] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:19.198590 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.209164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b99629-c5be-4bda-bf9e-6c453a76c628 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.214576 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75847b9f-292c-4ff3-86b4-5c9538aa53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.215175 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75847b9f-292c-4ff3-86b4-5c9538aa53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.215694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75847b9f-292c-4ff3-86b4-5c9538aa53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.216001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75847b9f-292c-4ff3-86b4-5c9538aa53f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.216676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75847b9f-292c-4ff3-86b4-5c9538aa53f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.218259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75847b9f-292c-4ff3-86b4-5c9538aa53f2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.229010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1230/2454] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:19.233169 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.243382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc035928-53cb-445f-8360-f1cc26be3a82 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.247957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.248626 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.248903 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.249172 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] PATH_INFO: `/v3/projects/89f9df59fa5c4cf7b501d047b3c7d161/users/332968312ad14db195e5b901fac0e481/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.263854 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f9df59fa5c4cf7b501d047b3c7d161, user_id=332968312ad14db195e5b901fac0e481, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.266499 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.281161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1225/2455] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:19 2022] PUT /identity/v3/projects/89f9df59fa5c4cf7b501d047b3c7d161/users/332968312ad14db195e5b901fac0e481/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:19.291426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.291732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.292006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.318884 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] MFA Rules not processed for user `332968312ad14db195e5b901fac0e481`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:19.320608 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:19.383114 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1231/2456] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:19.387634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.446987 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f7ec-d2f1-4e2d-bf7b-05a65c5bcbff admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.451489 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.452070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.452355 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.452642 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.453288 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.455159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.480689 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1226/2457] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:19 2022] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:19.484451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.495602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35172-41a1-4631-bf50-2fdab993ccb6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.550028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.550621 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.550923 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.551191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.551810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.554223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.575381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1232/2458] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:19 2022] POST /identity/v3/users => generated 306 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:19.579438 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.589565 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc527b-90e5-4f4d-b940-7e841033b3d2 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.594112 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.594697 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.594977 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.595249 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.595883 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.597491 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.608049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1227/2459] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:19.612134 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.622686 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1d48-a38b-4429-a944-6e0b998f8240 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.628118 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.628789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.629073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.629378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] PATH_INFO: `/v3/projects/56f4b7ab8f8f4c5c9479044833f50886/users/fcbb733d5a344b44b3e275ae9d13dece/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.644602 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f4b7ab8f8f4c5c9479044833f50886, user_id=fcbb733d5a344b44b3e275ae9d13dece, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.647176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.659663 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1233/2460] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:19 2022] PUT /identity/v3/projects/56f4b7ab8f8f4c5c9479044833f50886/users/fcbb733d5a344b44b3e275ae9d13dece/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:19.663723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.673836 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541f337-b53a-4f33-ade2-66838fd663a3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.729904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bfd0e-b052-4315-8766-c43efcd678ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.730504 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bfd0e-b052-4315-8766-c43efcd678ee admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.730784 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bfd0e-b052-4315-8766-c43efcd678ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.731057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bfd0e-b052-4315-8766-c43efcd678ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.731682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bfd0e-b052-4315-8766-c43efcd678ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.733294 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bfd0e-b052-4315-8766-c43efcd678ee admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.743517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1228/2461] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:19.747577 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.758238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae515d7f-77b0-406f-a64d-83e92f401c68 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.763548 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.764188 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.764499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.764771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] PATH_INFO: `/v3/projects/56f4b7ab8f8f4c5c9479044833f50886/users/fcbb733d5a344b44b3e275ae9d13dece/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.766648 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f4b7ab8f8f4c5c9479044833f50886, user_id=fcbb733d5a344b44b3e275ae9d13dece, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.769291 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.779790 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1234/2462] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:19 2022] PUT /identity/v3/projects/56f4b7ab8f8f4c5c9479044833f50886/users/fcbb733d5a344b44b3e275ae9d13dece/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:19.790342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.790851 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.790959 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.819645 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] MFA Rules not processed for user `fcbb733d5a344b44b3e275ae9d13dece`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:19.820879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:19.849899 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:19.889682 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1229/2463] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:19.902220 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:19.903922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:19.915607 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:19.962077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761a62-f915-4b44-b615-8b3921d4f2a8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:19.965705 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:19.966292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:19.966569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:19.966842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:19.976104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:19.977553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:19.986957 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1235/2464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:19 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:20.062028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:20.071598 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428d83-e171-46ce-80fa-24db55cd5ecb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:20.075131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5375-5d5f-47c2-b706-84063ce29d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:20.075717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5375-5d5f-47c2-b706-84063ce29d37 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:20.075995 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5375-5d5f-47c2-b706-84063ce29d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:20.076260 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5375-5d5f-47c2-b706-84063ce29d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:20.134051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be5375-5d5f-47c2-b706-84063ce29d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:20.135479 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be5375-5d5f-47c2-b706-84063ce29d37 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:20.144207 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1230/2465] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:24.192313 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:24.253758 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0c87-8df0-45c3-9a16-e05f7ae30c85 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:24.258732 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:24.259345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:24.259648 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:24.259915 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] PATH_INFO: `/v3/users/332968312ad14db195e5b901fac0e481` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:24.261043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332968312ad14db195e5b901fac0e481)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:24.262945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:24.307273 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332968312ad14db195e5b901fac0e481'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.318609 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332968312ad14db195e5b901fac0e481'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.319257 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332968312ad14db195e5b901fac0e481'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.326459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332968312ad14db195e5b901fac0e481'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.333375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332968312ad14db195e5b901fac0e481'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.339859 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1236/2466] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:24 2022] DELETE /identity/v3/users/332968312ad14db195e5b901fac0e481 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:24.344477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:24.344963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:24.345065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:24.364378 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:24.365570 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:24.422511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1231/2467] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:24.432235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:24.433678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:24.468055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:24.492896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31d6de-a0a8-4a5c-884b-99d66d00fd16 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:24.496543 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:24.497138 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:24.497415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:24.497688 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:24.506423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:24.508356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:24.517710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1237/2468] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:24.785369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:24.786872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:24.800860 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176a57-8b14-4055-84ca-b752da7a8760 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:24.805927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:24.806579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:24.806853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:24.807119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] PATH_INFO: `/v3/projects/89f9df59fa5c4cf7b501d047b3c7d161` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:24.808222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f9df59fa5c4cf7b501d047b3c7d161)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:24.810832 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:24.858522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f9df59fa5c4cf7b501d047b3c7d161', 'request_id': 'req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.865758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f9df59fa5c4cf7b501d047b3c7d161', 'request_id': 'req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.870036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:24.872410 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f9df59fa5c4cf7b501d047b3c7d161', 'request_id': 'req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.886483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] The token cache is being invalidate because project 89f9df59fa5c4cf7b501d047b3c7d161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:24.886773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.887398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:24.888897 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1232/2469] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:24 2022] DELETE /identity/v3/projects/89f9df59fa5c4cf7b501d047b3c7d161 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:24.892879 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:24.903573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4ace1-4624-4f21-bcec-0821d7546f52 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:24.962047 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:24.962714 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:24.962994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:24.963268 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] PATH_INFO: `/v3/users/fcbb733d5a344b44b3e275ae9d13dece` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:24.964435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbb733d5a344b44b3e275ae9d13dece)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:24.966400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.011409 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbb733d5a344b44b3e275ae9d13dece'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.023149 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbb733d5a344b44b3e275ae9d13dece'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.023829 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbb733d5a344b44b3e275ae9d13dece'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.030583 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbb733d5a344b44b3e275ae9d13dece'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.037017 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0471c356-2400-4d0e-a184-81e0461036a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbb733d5a344b44b3e275ae9d13dece'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.043501 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1238/2470] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:24 2022] DELETE /identity/v3/users/fcbb733d5a344b44b3e275ae9d13dece => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:25.308894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.310338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:25.323555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad6e36-5bc4-4e49-8d3c-3c0dd444cea7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.382331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.383018 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.383251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.383522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] PATH_INFO: `/v3/projects/56f4b7ab8f8f4c5c9479044833f50886` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.384688 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f4b7ab8f8f4c5c9479044833f50886)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.386579 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.432640 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f4b7ab8f8f4c5c9479044833f50886', 'request_id': 'req-3452a9b2-43de-4f63-8cba-b830a5a5682e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.439534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f4b7ab8f8f4c5c9479044833f50886', 'request_id': 'req-3452a9b2-43de-4f63-8cba-b830a5a5682e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.445080 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f4b7ab8f8f4c5c9479044833f50886', 'request_id': 'req-3452a9b2-43de-4f63-8cba-b830a5a5682e'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.456015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] The token cache is being invalidate because project 56f4b7ab8f8f4c5c9479044833f50886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:25.456304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.456948 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-3452a9b2-43de-4f63-8cba-b830a5a5682e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:25.458390 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1233/2471] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:25 2022] DELETE /identity/v3/projects/56f4b7ab8f8f4c5c9479044833f50886 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:25.464588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.465075 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.465183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.485106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:25.486551 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:25.531694 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:25.545784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1239/2472] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:25.554562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.554841 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.555110 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.574514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:25.575694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:25.583347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1234/2473] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:25.588090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.597690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d257a7b-1393-4b4a-85e8-9201b11d9909 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.602868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.603461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.603740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.604011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.604684 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:14:25.604986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.606569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.618224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1240/2474] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:14:25.622316 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.631310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753ccc7-a003-4dad-a2f9-bc0737ccdd1c None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.635944 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.636660 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.636837 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.637106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.637728 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.639599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.667360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1235/2475] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:14:25 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:25.671429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.681364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666171f3-7103-4438-9588-b84fc6c906fa admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.736648 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.737166 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.737442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.737713 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.738319 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.740219 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.760600 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1241/2476] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:14:25 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:14:25.764794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.775430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a25bd9-faf9-4b53-b92e-a434ed1b14e6 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.779947 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.780576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.780853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.781122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.781752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.783311 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.792954 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1236/2477] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:25.796800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.806423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fb2d8-537e-433f-ba65-82f20bfaaa50 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.810978 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152f86-c92d-4628-b2a7-c2136b7b53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.811559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152f86-c92d-4628-b2a7-c2136b7b53db admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.811836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152f86-c92d-4628-b2a7-c2136b7b53db admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.812107 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152f86-c92d-4628-b2a7-c2136b7b53db admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.812780 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152f86-c92d-4628-b2a7-c2136b7b53db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.814348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152f86-c92d-4628-b2a7-c2136b7b53db admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.825233 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1242/2478] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:14:25.829119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.839427 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b6bed-b7e8-499d-b6e1-dfb3ec4f1368 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:25.844083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:25.844754 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.845034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.845307 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] PATH_INFO: `/v3/projects/c5e42351f6ee498db7b4d56049cb02e9/users/139a4343f6c74da5b373860f6880924c/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.860245 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e42351f6ee498db7b4d56049cb02e9, user_id=139a4343f6c74da5b373860f6880924c, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:25.863171 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:25.875120 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1237/2479] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:14:25 2022] PUT /identity/v3/projects/c5e42351f6ee498db7b4d56049cb02e9/users/139a4343f6c74da5b373860f6880924c/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:25.885791 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:25.886073 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:25.886347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:25.913894 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] MFA Rules not processed for user `139a4343f6c74da5b373860f6880924c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:25.915092 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:25.982079 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1243/2480] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:25.993649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:25.995331 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:26.013895 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:26.054291 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf915b-561e-49fb-add3-b345f5f4569b admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:26.057923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9000c-e224-4b2a-a1f1-ce3670fd6af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:26.058521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9000c-e224-4b2a-a1f1-ce3670fd6af0 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:26.058800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9000c-e224-4b2a-a1f1-ce3670fd6af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:26.059073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9000c-e224-4b2a-a1f1-ce3670fd6af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:26.067282 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9000c-e224-4b2a-a1f1-ce3670fd6af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:26.068739 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9000c-e224-4b2a-a1f1-ce3670fd6af0 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:26.077798 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1238/2481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:26.103151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:26.151259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:26.165716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382cc56-0313-4643-9a87-85b4931fca12 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:26.170263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:26.170888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:26.171167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:26.171442 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] PATH_INFO: `/v3/users/139a4343f6c74da5b373860f6880924c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:26.172662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139a4343f6c74da5b373860f6880924c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:26.174603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:26.220225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139a4343f6c74da5b373860f6880924c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.231830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139a4343f6c74da5b373860f6880924c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.232570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139a4343f6c74da5b373860f6880924c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.239579 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139a4343f6c74da5b373860f6880924c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.246643 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139a4343f6c74da5b373860f6880924c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.252620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1244/2482] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:26 2022] DELETE /identity/v3/users/139a4343f6c74da5b373860f6880924c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:26.257945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:26.258230 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:26.258505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:26.278488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:26.279680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:26.337159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1239/2483] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:26.346821 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:26.348209 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:26.405476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880130-dbde-4ad0-8c82-c1d6a2421166 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:26.409210 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280ebc-f595-487a-93be-237fda4d8348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:26.409809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280ebc-f595-487a-93be-237fda4d8348 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:26.410085 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280ebc-f595-487a-93be-237fda4d8348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:26.410371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280ebc-f595-487a-93be-237fda4d8348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:26.419317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8280ebc-f595-487a-93be-237fda4d8348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:26.420777 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8280ebc-f595-487a-93be-237fda4d8348 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:26.430483 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1245/2484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:14:26.693494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:26.694969 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:26.707038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f691cd-0897-42db-91e0-ea1b67e49ee9 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:26.711966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:26.712914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:26.713190 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:26.713455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] PATH_INFO: `/v3/projects/c5e42351f6ee498db7b4d56049cb02e9` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:26.714568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e42351f6ee498db7b4d56049cb02e9)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:26.717161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:26.764354 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e42351f6ee498db7b4d56049cb02e9', 'request_id': 'req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.771462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e42351f6ee498db7b4d56049cb02e9', 'request_id': 'req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.777297 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e42351f6ee498db7b4d56049cb02e9', 'request_id': 'req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.788787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] The token cache is being invalidate because project c5e42351f6ee498db7b4d56049cb02e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:26.789095 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.789725 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:26.791184 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1240/2485] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:26 2022] DELETE /identity/v3/projects/c5e42351f6ee498db7b4d56049cb02e9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:36.425985 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:36.785308 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:39.970439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:39.970940 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:39.971039 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:39.989926 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] MFA Rules not processed for user `1c62cd022bcc4eac9b90cb5e9596a56c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:14:39.991122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:40.044745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1246/2486] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:14:50.038199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=25 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:51.538408 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:51.542161 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:51.614924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcf41-2098-4b75-bb66-af3cdac2c9e0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:51.619706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:51.620326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:51.620627 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:51.620915 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] PATH_INFO: `/v3/users/dc8fbdb556fe40c7bdbb4e21c01e7a35` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:51.622000 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8fbdb556fe40c7bdbb4e21c01e7a35)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:51.623889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:51.669364 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8fbdb556fe40c7bdbb4e21c01e7a35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:51.681255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8fbdb556fe40c7bdbb4e21c01e7a35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:51.681916 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8fbdb556fe40c7bdbb4e21c01e7a35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:51.688875 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8fbdb556fe40c7bdbb4e21c01e7a35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:51.697508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8fbdb556fe40c7bdbb4e21c01e7a35'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:51.704887 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1241/2487] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:51 2022] DELETE /identity/v3/users/dc8fbdb556fe40c7bdbb4e21c01e7a35 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:51.890136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:51.901787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56236-b8b8-4d66-a361-28bd3a8db546 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:51.959346 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:51.959965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:51.960239 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:51.960536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] PATH_INFO: `/v3/projects/e27d1b8731414ba2841c5f4637c0f75f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:51.962250 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27d1b8731414ba2841c5f4637c0f75f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:51.964122 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:52.009317 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27d1b8731414ba2841c5f4637c0f75f', 'request_id': 'req-29607758-972e-4ebf-a17b-74baa70716bd'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.016314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27d1b8731414ba2841c5f4637c0f75f', 'request_id': 'req-29607758-972e-4ebf-a17b-74baa70716bd'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.021660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27d1b8731414ba2841c5f4637c0f75f', 'request_id': 'req-29607758-972e-4ebf-a17b-74baa70716bd'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.032378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] The token cache is being invalidate because project e27d1b8731414ba2841c5f4637c0f75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:52.032664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.033282 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.034740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1247/2488] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:51 2022] DELETE /identity/v3/projects/e27d1b8731414ba2841c5f4637c0f75f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:52.038709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:52.040241 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:52.053133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7695aa-3ef7-483b-82dc-54a143235437 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:52.109538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:52.110192 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:52.110730 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:52.111015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] PATH_INFO: `/v3/users/f83b831acc7d44c497d63cf48fd66341` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:52.112103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83b831acc7d44c497d63cf48fd66341)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:52.114038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:52.136254 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:52.159714 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83b831acc7d44c497d63cf48fd66341'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.171624 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83b831acc7d44c497d63cf48fd66341'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.172406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83b831acc7d44c497d63cf48fd66341'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.179124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83b831acc7d44c497d63cf48fd66341'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.187339 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83b831acc7d44c497d63cf48fd66341'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.193118 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1242/2489] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:14:52 2022] DELETE /identity/v3/users/f83b831acc7d44c497d63cf48fd66341 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:14:52.363549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:14:52.365029 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:14:52.378634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607758-972e-4ebf-a17b-74baa70716bd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:14:52.435348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:14:52.435974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:14:52.436255 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:14:52.436557 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] PATH_INFO: `/v3/projects/0ec6b4580c20442a8129e86ee78f0368` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:14:52.437674 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec6b4580c20442a8129e86ee78f0368)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:14:52.439566 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:14:52.473049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:14:52.487651 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec6b4580c20442a8129e86ee78f0368', 'request_id': 'req-6fca9969-ff49-43dd-8248-f49053112558'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.495666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec6b4580c20442a8129e86ee78f0368', 'request_id': 'req-6fca9969-ff49-43dd-8248-f49053112558'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.501718 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec6b4580c20442a8129e86ee78f0368', 'request_id': 'req-6fca9969-ff49-43dd-8248-f49053112558'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.513327 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] The token cache is being invalidate because project 0ec6b4580c20442a8129e86ee78f0368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:14:52.513614 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.514305 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:14:52.515787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1248/2490] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:14:52 2022] DELETE /identity/v3/projects/0ec6b4580c20442a8129e86ee78f0368 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:02.189670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:02.510162 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:32.683766 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:32.685255 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:32.740698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352079-0606-4915-a1ed-ce8b9b79561f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:32.787855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:32.788482 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:32.788761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:32.789032 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:32.791271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:32.859250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:32.860973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:32.872656 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1243/2491] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:34.414013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:34.415426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:34.428672 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca9969-ff49-43dd-8248-f49053112558 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:34.432164 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:34.432810 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:34.433087 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:34.433356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:34.434959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:34.448249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:34.449683 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:34.460724 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1249/2492] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:42.866938 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=74 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:44.455673 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:46.531333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.532844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:46.600937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c486-f625-4f1a-bd80-c59ffd1d9a63 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.605610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.606234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.606507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.606773 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] PATH_INFO: `/v3/users/1c62cd022bcc4eac9b90cb5e9596a56c` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.607926 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c62cd022bcc4eac9b90cb5e9596a56c)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.609934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.657140 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c62cd022bcc4eac9b90cb5e9596a56c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:46.678855 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c62cd022bcc4eac9b90cb5e9596a56c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:46.679646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c62cd022bcc4eac9b90cb5e9596a56c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:46.687634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c62cd022bcc4eac9b90cb5e9596a56c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:46.696670 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d625e7b6-b08b-4dfd-8b8e-e95a7412d812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c62cd022bcc4eac9b90cb5e9596a56c'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:46.703902 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1244/2493] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:46 2022] DELETE /identity/v3/users/1c62cd022bcc4eac9b90cb5e9596a56c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:46.875682 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:46.886395 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe22b-fdfb-4ee7-9cd8-4787d563c2ef service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:46.943494 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:46.944115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:46.944425 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:46.944700 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] PATH_INFO: `/v3/projects/e276b72d86a94c86a419a49a54363a77` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:46.945800 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e276b72d86a94c86a419a49a54363a77)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:46.947712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:46.993712 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e276b72d86a94c86a419a49a54363a77', 'request_id': 'req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:47.000804 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e276b72d86a94c86a419a49a54363a77', 'request_id': 'req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:47.006131 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e276b72d86a94c86a419a49a54363a77', 'request_id': 'req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:47.017420 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] The token cache is being invalidate because project e276b72d86a94c86a419a49a54363a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:47.017703 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:47.018309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-1d8d77bf-50b2-4b22-a500-fd7c2ca7ab2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:47.019748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1250/2494] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:46 2022] DELETE /identity/v3/projects/e276b72d86a94c86a419a49a54363a77 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:47.024590 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.024879 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.025155 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.046683 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:47.047885 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:47.109996 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1245/2495] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:47.118160 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.118519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.118863 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.139679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:47.140903 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:47.148722 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1251/2496] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:47.153468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.163180 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa417-94bb-4847-a5c1-edeb6a8a8f97 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.168587 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.169209 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.169494 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.169764 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.170417 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:15:47.170720 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.172310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.184529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1246/2497] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:15:47.188870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.198097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446467-f4e7-4462-9150-25a4f0b16aeb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.203221 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.203806 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.204080 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.204374 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.205031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.206933 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.242931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1252/2498] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:47.247191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.256893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acbd4-6de4-4c31-9b07-35368dd0663f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.260455 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:47.315333 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.315941 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.316222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.316530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.317157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.319064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.340698 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1247/2499] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:47.344760 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.354999 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2576-4f38-4409-abd7-2a7b45a34781 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.360400 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.361014 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.361306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.361569 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.362216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.363936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.374814 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1253/2500] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:47.378824 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.389266 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e2e6-f36f-4f70-b14a-b664dd91a1b0 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.393787 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4270c-87b5-44c1-b8a3-702f3cee8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.394374 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4270c-87b5-44c1-b8a3-702f3cee8291 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.394648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4270c-87b5-44c1-b8a3-702f3cee8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.394914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4270c-87b5-44c1-b8a3-702f3cee8291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.395534 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4270c-87b5-44c1-b8a3-702f3cee8291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.397170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4270c-87b5-44c1-b8a3-702f3cee8291 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.407661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1248/2501] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:47.411512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.421452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830494-5b86-46a9-8c66-cc3d6ed1497b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.426023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.426657 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.426938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.427212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] PATH_INFO: `/v3/projects/14230d7f6f98482f99d3804128de77a0/users/04e45b79b3b141a38ed69ba83d45a0f3/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.443363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14230d7f6f98482f99d3804128de77a0, user_id=04e45b79b3b141a38ed69ba83d45a0f3, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.446034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.461867 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1254/2502] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:47 2022] PUT /identity/v3/projects/14230d7f6f98482f99d3804128de77a0/users/04e45b79b3b141a38ed69ba83d45a0f3/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:47.472076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.472392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.472665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.500377 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] MFA Rules not processed for user `04e45b79b3b141a38ed69ba83d45a0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:47.501471 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:47.564743 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1249/2503] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:47.569445 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.589796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:47.634417 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448b428-41f3-45ce-8398-cbff1803a6b6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.639068 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.639662 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.639941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.640212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.640864 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.642744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.669489 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1255/2504] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:47.673576 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.684164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c18b3-8f92-4154-9826-612ed7f6b160 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.738914 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.739508 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.739786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.740054 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.740703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.742601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.763527 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1250/2505] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:47.767619 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.778295 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6fc5-bac5-4913-b6a6-c09d5996548d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.782869 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.783455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.783735 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.784009 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.784737 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.786320 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.796927 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1256/2506] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:15:47.800894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.807143 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:47.810932 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300d6d-512d-443e-a147-7cce0115e6db admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.816859 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.817505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.817781 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.818051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] PATH_INFO: `/v3/projects/58cbaea7520349a789d0d687dfec7f9c/users/76f5a6004e44404ea161572efa72fe45/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.833116 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cbaea7520349a789d0d687dfec7f9c, user_id=76f5a6004e44404ea161572efa72fe45, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.835751 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.848665 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1251/2507] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:47 2022] PUT /identity/v3/projects/58cbaea7520349a789d0d687dfec7f9c/users/76f5a6004e44404ea161572efa72fe45/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:47.852570 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.863266 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d4ae-c5f5-4d38-86b7-ac875dc97da1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.918744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8467ff4-ab5e-4b2a-ae1a-e150c906e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.919387 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467ff4-ab5e-4b2a-ae1a-e150c906e770 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.919597 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467ff4-ab5e-4b2a-ae1a-e150c906e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.919868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8467ff4-ab5e-4b2a-ae1a-e150c906e770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.920523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467ff4-ab5e-4b2a-ae1a-e150c906e770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.922097 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8467ff4-ab5e-4b2a-ae1a-e150c906e770 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.931588 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1257/2508] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:47.936243 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:47.946496 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cef5d6-5576-45a8-b1b4-8738e9fc8161 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:47.951164 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:47.951808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.952090 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.952396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] PATH_INFO: `/v3/projects/58cbaea7520349a789d0d687dfec7f9c/users/76f5a6004e44404ea161572efa72fe45/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:47.954296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cbaea7520349a789d0d687dfec7f9c, user_id=76f5a6004e44404ea161572efa72fe45, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:47.956946 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:47.967069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1252/2509] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:47 2022] PUT /identity/v3/projects/58cbaea7520349a789d0d687dfec7f9c/users/76f5a6004e44404ea161572efa72fe45/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:47.978326 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:47.978612 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:47.978895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:48.007223 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] MFA Rules not processed for user `76f5a6004e44404ea161572efa72fe45`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:48.008450 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:48.074381 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1258/2510] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:48.085134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:48.086853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:48.145831 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8874-f5d4-4282-91b5-af0f02c72312 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:48.149501 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:48.150101 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:48.150383 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:48.150658 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:48.159511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:48.160982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:48.170287 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1253/2511] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:48.272640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:48.282094 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc477a2-7a7d-4443-8551-9469cd69653b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:48.285593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa096ba-219e-4085-8b28-258bf6fb2a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:48.286180 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa096ba-219e-4085-8b28-258bf6fb2a7a service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:48.286452 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa096ba-219e-4085-8b28-258bf6fb2a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:48.286719 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa096ba-219e-4085-8b28-258bf6fb2a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:48.295832 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:48.343212 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa096ba-219e-4085-8b28-258bf6fb2a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:48.344678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa096ba-219e-4085-8b28-258bf6fb2a7a service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:48.353520 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1259/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:50.925162 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:50.985563 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4310e-89ca-4a63-b6ef-ba8899ffdc4f service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:50.989958 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:50.990596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:50.990868 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:50.991134 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] PATH_INFO: `/v3/users/04e45b79b3b141a38ed69ba83d45a0f3` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:50.992219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e45b79b3b141a38ed69ba83d45a0f3)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:50.994139 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:51.039399 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e45b79b3b141a38ed69ba83d45a0f3'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.051596 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e45b79b3b141a38ed69ba83d45a0f3'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.052275 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e45b79b3b141a38ed69ba83d45a0f3'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.057517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:51.060529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e45b79b3b141a38ed69ba83d45a0f3'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.068248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e45b79b3b141a38ed69ba83d45a0f3'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.074529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1254/2513] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:50 2022] DELETE /identity/v3/users/04e45b79b3b141a38ed69ba83d45a0f3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:51.079069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:51.079527 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:51.079652 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:51.099216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:51.100433 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:51.160768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1260/2514] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:51.171278 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:51.172759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:51.234988 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2c65-11ae-4677-beb0-3f567a1b1ed7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:51.238881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:51.239480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:51.239756 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:51.240023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:51.249467 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:51.250889 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:51.260119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1255/2515] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:51.528468 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:51.529955 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:51.542297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722cab-01b1-407d-88dc-1f5b9e57481f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:51.548841 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:51.549513 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:51.549746 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:51.550020 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] PATH_INFO: `/v3/projects/14230d7f6f98482f99d3804128de77a0` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:51.551146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14230d7f6f98482f99d3804128de77a0)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:51.553104 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:51.601676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14230d7f6f98482f99d3804128de77a0', 'request_id': 'req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.609136 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14230d7f6f98482f99d3804128de77a0', 'request_id': 'req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.614891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14230d7f6f98482f99d3804128de77a0', 'request_id': 'req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.626197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] The token cache is being invalidate because project 14230d7f6f98482f99d3804128de77a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:51.626480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.627099 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.628605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1261/2516] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:51 2022] DELETE /identity/v3/projects/14230d7f6f98482f99d3804128de77a0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:51.632741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:51.642726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fe35-3307-4862-9af7-eb95aa92c013 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:51.698122 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:51.699210 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:51.699488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:51.699761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] PATH_INFO: `/v3/users/76f5a6004e44404ea161572efa72fe45` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:51.700898 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f5a6004e44404ea161572efa72fe45)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:51.702800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:51.747843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f5a6004e44404ea161572efa72fe45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.759292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f5a6004e44404ea161572efa72fe45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.759937 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f5a6004e44404ea161572efa72fe45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.767396 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f5a6004e44404ea161572efa72fe45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.774511 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-9b3c42c2-9d51-4f16-b456-4bffcf3a6385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f5a6004e44404ea161572efa72fe45'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:51.780904 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1256/2517] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:51 2022] DELETE /identity/v3/users/76f5a6004e44404ea161572efa72fe45 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:52.042747 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.044195 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.060401 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eacf3-0fd5-4114-985a-4e1f38c6c87d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.094194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:52.119594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.120215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.121171 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.121449 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] PATH_INFO: `/v3/projects/58cbaea7520349a789d0d687dfec7f9c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.122571 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cbaea7520349a789d0d687dfec7f9c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.124493 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.169375 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cbaea7520349a789d0d687dfec7f9c', 'request_id': 'req-901b3ebf-4e74-41bd-946d-8f76580769ca'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:52.176023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cbaea7520349a789d0d687dfec7f9c', 'request_id': 'req-901b3ebf-4e74-41bd-946d-8f76580769ca'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:52.181435 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cbaea7520349a789d0d687dfec7f9c', 'request_id': 'req-901b3ebf-4e74-41bd-946d-8f76580769ca'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:52.192230 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] The token cache is being invalidate because project 58cbaea7520349a789d0d687dfec7f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:52.192541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:52.193159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-901b3ebf-4e74-41bd-946d-8f76580769ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:52.194628 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1262/2518] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:52 2022] DELETE /identity/v3/projects/58cbaea7520349a789d0d687dfec7f9c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:52.199449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.199929 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.200045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.219736 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:52.220907 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.226051 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:52.281560 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1257/2519] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:52.289231 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.289549 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.289826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.310393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:52.311584 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.319368 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1263/2520] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:52.324039 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.333610 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687a1b6-7da7-42d9-9e33-a3bd5a1c828d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.338292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.338881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.339772 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.340045 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.340709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:15:52.341013 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.342711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.354246 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1258/2521] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:15:52.358307 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.367904 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0e2a0-1e3d-4d11-a138-4c3847bcde8c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.372516 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.373106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.373378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.373646 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.374279 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.376145 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.403451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1264/2522] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:15:52.407733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.417755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aaae2-2afb-4a69-8398-ef3d3b0ff6bd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.474464 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.474992 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.475272 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.475546 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.476157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.478091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.498462 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1259/2523] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:52.502733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.513396 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf7348-45c9-4332-a9c9-b1a45f901803 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.517941 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.518523 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.518796 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.519064 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.519692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.521293 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.532030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1265/2524] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:52.535896 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.545711 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbfcf-3ab6-4e63-90d4-edbb10343f13 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.550514 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3140f3-f671-48a7-9c8a-b8c7a0561dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.551104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3140f3-f671-48a7-9c8a-b8c7a0561dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.551382 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3140f3-f671-48a7-9c8a-b8c7a0561dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.551649 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3140f3-f671-48a7-9c8a-b8c7a0561dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.552273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3140f3-f671-48a7-9c8a-b8c7a0561dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.553919 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3140f3-f671-48a7-9c8a-b8c7a0561dc3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.564745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1260/2525] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:52.568623 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.579034 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603309b4-445d-42a3-812a-57c1059fd7ac admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.583561 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.584191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.584495 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.584768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] PATH_INFO: `/v3/projects/d3f61a74e46f4045b36144c80b8e03e5/users/11ad808a14f8405c8011cea144b45045/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.599536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f61a74e46f4045b36144c80b8e03e5, user_id=11ad808a14f8405c8011cea144b45045, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.602184 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.615309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1266/2526] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:52 2022] PUT /identity/v3/projects/d3f61a74e46f4045b36144c80b8e03e5/users/11ad808a14f8405c8011cea144b45045/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:52.627189 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.627475 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.627747 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.655304 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] MFA Rules not processed for user `11ad808a14f8405c8011cea144b45045`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:52.656526 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:52.717970 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1261/2527] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:15:52.722563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.783284 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63aeb9-6668-4caf-8f50-4cc8ac8f6096 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.787808 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.788426 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.788704 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.788975 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.789585 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.791454 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.796731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:52.819708 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1267/2528] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:52.823776 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.834634 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ae4be-1818-4aef-81be-2a307b6ecb29 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.838072 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:52.891843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.892476 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.892755 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.893024 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.893648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.895541 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.916398 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1262/2529] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:15:52 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:15:52.920471 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.930415 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0fe8f-fbec-4ec0-83ac-c05bdd8de4f3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.935634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.936258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.936563 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.936837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.937467 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.939035 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.949715 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1268/2530] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:52.953562 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:52.963540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580f7c2-11b8-4ef2-a3c3-315395036fc5 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:52.968119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:52.968782 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:52.969061 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:52.969334 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] PATH_INFO: `/v3/projects/6a655c63c0284bf19fed4fa813cce6d4/users/157474afc65f4abc8f2b86bd58de7ee6/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:52.984248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a655c63c0284bf19fed4fa813cce6d4, user_id=157474afc65f4abc8f2b86bd58de7ee6, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:52.987165 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:52.999799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1263/2531] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:52 2022] PUT /identity/v3/projects/6a655c63c0284bf19fed4fa813cce6d4/users/157474afc65f4abc8f2b86bd58de7ee6/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:53.003711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:53.013518 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bebe5-78f4-4145-affc-c4166dac3fbf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:53.068478 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d843662-6128-4453-a8c9-3ed1f9cf136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:53.069205 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d843662-6128-4453-a8c9-3ed1f9cf136e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:53.069389 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d843662-6128-4453-a8c9-3ed1f9cf136e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:53.069698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d843662-6128-4453-a8c9-3ed1f9cf136e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:53.070410 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d843662-6128-4453-a8c9-3ed1f9cf136e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:53.072030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d843662-6128-4453-a8c9-3ed1f9cf136e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:53.081660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1269/2532] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:15:53.085777 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:53.096414 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752bd5-28d3-4a8c-9f6b-81e233dd97a7 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:53.101091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:53.101768 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:53.102043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:53.102342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] PATH_INFO: `/v3/projects/6a655c63c0284bf19fed4fa813cce6d4/users/157474afc65f4abc8f2b86bd58de7ee6/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:53.104248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a655c63c0284bf19fed4fa813cce6d4, user_id=157474afc65f4abc8f2b86bd58de7ee6, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:53.107586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:53.118273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1264/2533] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:15:53 2022] PUT /identity/v3/projects/6a655c63c0284bf19fed4fa813cce6d4/users/157474afc65f4abc8f2b86bd58de7ee6/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:53.129920 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002889-6903-4641-9534-704d533fc088 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:53.130421 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002889-6903-4641-9534-704d533fc088 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:53.130534 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49002889-6903-4641-9534-704d533fc088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:53.157779 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-49002889-6903-4641-9534-704d533fc088 None None] MFA Rules not processed for user `157474afc65f4abc8f2b86bd58de7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:53.158974 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-49002889-6903-4641-9534-704d533fc088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:53.224981 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1270/2534] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:53.236973 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:53.238717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:53.296421 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d02931-78f4-4331-80be-1f542df265fe admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:53.299931 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:53.300551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:53.300830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:53.301099 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:53.310366 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:53.311778 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:53.321028 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1265/2535] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:53.469883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002889-6903-4641-9534-704d533fc088 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:53.479739 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49002889-6903-4641-9534-704d533fc088 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:53.483803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c28f-76cb-4263-8228-df7d7c4974c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:53.484455 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c28f-76cb-4263-8228-df7d7c4974c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:53.484731 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c28f-76cb-4263-8228-df7d7c4974c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:53.484992 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c28f-76cb-4263-8228-df7d7c4974c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:53.538198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:53.540842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c28f-76cb-4263-8228-df7d7c4974c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:53.543264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c28f-76cb-4263-8228-df7d7c4974c2 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:53.552787 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1271/2536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:53 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:58.954750 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:59.015752 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729bb65-dda0-415a-a4b8-297663a383b1 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:59.020197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:59.020943 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:59.021219 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:59.021488 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] PATH_INFO: `/v3/users/11ad808a14f8405c8011cea144b45045` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:59.022586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ad808a14f8405c8011cea144b45045)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:59.024530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:59.026861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:59.072010 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ad808a14f8405c8011cea144b45045'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.083672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ad808a14f8405c8011cea144b45045'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.084325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ad808a14f8405c8011cea144b45045'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.091195 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ad808a14f8405c8011cea144b45045'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.098803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ad808a14f8405c8011cea144b45045'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.105924 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1266/2537] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:58 2022] DELETE /identity/v3/users/11ad808a14f8405c8011cea144b45045 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:59.110658 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:59.111115 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:59.111217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:59.130640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:15:59.131834 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:59.188344 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1272/2538] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:15:59.198089 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:59.199510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:59.261057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c95b2-da1d-48a1-99f3-5686fa447ad9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:59.264741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:59.265353 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:59.265637 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:59.265913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:59.274816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:59.276234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:59.285564 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1267/2539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:15:59.553172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:59.554625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:15:59.567031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec8deb-7420-44b1-8c47-d45b040e7a6f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:59.571833 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:59.572637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:59.573232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:59.574238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] PATH_INFO: `/v3/projects/d3f61a74e46f4045b36144c80b8e03e5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:59.575620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f61a74e46f4045b36144c80b8e03e5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:59.579475 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:59.637024 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f61a74e46f4045b36144c80b8e03e5', 'request_id': 'req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.645238 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f61a74e46f4045b36144c80b8e03e5', 'request_id': 'req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.650959 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f61a74e46f4045b36144c80b8e03e5', 'request_id': 'req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.664728 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] The token cache is being invalidate because project d3f61a74e46f4045b36144c80b8e03e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:15:59.665012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.665637 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.667698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1273/2540] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:15:59 2022] DELETE /identity/v3/projects/d3f61a74e46f4045b36144c80b8e03e5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:15:59.672486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:15:59.684363 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b482c-5498-42fd-b1bd-27610c5a3a35 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:15:59.745547 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:15:59.746167 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:15:59.746442 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:15:59.746710 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] PATH_INFO: `/v3/users/157474afc65f4abc8f2b86bd58de7ee6` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:15:59.748066 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157474afc65f4abc8f2b86bd58de7ee6)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:15:59.750695 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:15:59.782150 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:15:59.801759 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157474afc65f4abc8f2b86bd58de7ee6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.813694 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157474afc65f4abc8f2b86bd58de7ee6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.814379 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157474afc65f4abc8f2b86bd58de7ee6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.821270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157474afc65f4abc8f2b86bd58de7ee6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.829019 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-d67fe836-42a1-45e0-9461-3d7fefcfb184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157474afc65f4abc8f2b86bd58de7ee6'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:15:59.834963 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1268/2541] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:15:59 2022] DELETE /identity/v3/users/157474afc65f4abc8f2b86bd58de7ee6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:00.117388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.118880 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:00.133126 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e96e-c0ec-4b52-b25d-80495ffd0ea9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.191335 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.191896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.192172 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.192479 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] PATH_INFO: `/v3/projects/6a655c63c0284bf19fed4fa813cce6d4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.193592 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a655c63c0284bf19fed4fa813cce6d4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.195488 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.218196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:00.241490 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a655c63c0284bf19fed4fa813cce6d4', 'request_id': 'req-2b196dbd-74e2-4f54-b540-c502f432d51f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:00.249002 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a655c63c0284bf19fed4fa813cce6d4', 'request_id': 'req-2b196dbd-74e2-4f54-b540-c502f432d51f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:00.254537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a655c63c0284bf19fed4fa813cce6d4', 'request_id': 'req-2b196dbd-74e2-4f54-b540-c502f432d51f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:00.266010 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] The token cache is being invalidate because project 6a655c63c0284bf19fed4fa813cce6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:00.266298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:00.266965 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2b196dbd-74e2-4f54-b540-c502f432d51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:00.268560 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1274/2542] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:00 2022] DELETE /identity/v3/projects/6a655c63c0284bf19fed4fa813cce6d4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:00.273356 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.273815 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.273910 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.293758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:00.294967 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:00.353159 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1269/2543] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:00.361265 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.361573 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.361883 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.381768 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:00.382994 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:00.391378 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1275/2544] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:00.395551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.405181 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec39dfe-0ea0-42b8-aa5f-6be4f73e1500 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.409920 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.410521 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.410803 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.411079 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.411726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:16:00.412047 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.413667 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.425312 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1270/2545] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:16:00.429397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.438931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81594a8d-eaa7-4e4f-be62-b650af3c5f0e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.443605 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.444135 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.444443 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.444717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.445345 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.447227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.475055 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1276/2546] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:00.479103 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.489724 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dda87-7fc7-4a6e-8f02-07ff62caeb56 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.544513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.545097 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.545372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.545646 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.546251 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.548137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.569034 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1271/2547] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:00.573183 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.583173 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a8e7a-8375-4071-877a-111efa49a338 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.587736 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.588318 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.588625 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.589037 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.589659 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.591249 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.601048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1277/2548] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:00.605638 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.615601 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac949e-3a07-4ac5-842d-31c155285e33 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.620923 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c387c9-f9cf-4153-b619-3dce81d71421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.621510 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c387c9-f9cf-4153-b619-3dce81d71421 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.621785 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c387c9-f9cf-4153-b619-3dce81d71421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.622052 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c387c9-f9cf-4153-b619-3dce81d71421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.622676 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c387c9-f9cf-4153-b619-3dce81d71421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.624248 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c387c9-f9cf-4153-b619-3dce81d71421 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.634717 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1272/2549] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 26 11:16:00.638984 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.648764 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98149cef-1365-4b05-90e1-4cccb0877a5e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.653436 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.654069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.654347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.654620 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] PATH_INFO: `/v3/projects/09d836696a9b404fab255c913942040c/users/cae821ee854f4e09af658ed316ab8d87/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.669995 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d836696a9b404fab255c913942040c, user_id=cae821ee854f4e09af658ed316ab8d87, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.672709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.686224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1278/2550] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:00 2022] PUT /identity/v3/projects/09d836696a9b404fab255c913942040c/users/cae821ee854f4e09af658ed316ab8d87/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:00.697709 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.698064 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.698348 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.717503 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:00.727881 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] MFA Rules not processed for user `cae821ee854f4e09af658ed316ab8d87`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:00.729104 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:00.791341 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1273/2551] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:00.796290 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.856729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f09996-e330-49b2-bfde-4cdb754974db admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.862510 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.863112 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.863419 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.863693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.864314 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.866277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.891640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1279/2552] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:00.895672 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:00.906599 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423062-e8ac-4462-995e-6bfa3414174d None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:00.961908 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:00.962449 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:00.962715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:00.962982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:00.963604 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:00.966043 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:00.987264 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1274/2553] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:00 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:00.991194 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:01.001636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec631-8697-48c4-81db-11fe41952927 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:01.006235 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:01.006826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:01.007106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:01.007383 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:01.008036 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:01.009693 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:01.020179 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1280/2554] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:01.024073 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:01.034298 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e7c97-6627-4d08-a218-8d348493029f admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:01.038893 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:01.039520 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:01.039800 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:01.040062 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] PATH_INFO: `/v3/projects/f11e9c8fbe3249109325284f3c8f7ed1/users/580654a249054de988b86d6c1e3f6ee1/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:01.055057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11e9c8fbe3249109325284f3c8f7ed1, user_id=580654a249054de988b86d6c1e3f6ee1, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:01.057722 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:01.069982 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1275/2555] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:01 2022] PUT /identity/v3/projects/f11e9c8fbe3249109325284f3c8f7ed1/users/580654a249054de988b86d6c1e3f6ee1/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:01.073851 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:01.084069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ea99-1400-4829-ba76-d0da4c8b4035 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:01.105820 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:01.146710 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c537c7d-6b02-4b4f-9448-467a2b15c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:01.147324 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c537c7d-6b02-4b4f-9448-467a2b15c704 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:01.147580 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c537c7d-6b02-4b4f-9448-467a2b15c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:01.147857 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c537c7d-6b02-4b4f-9448-467a2b15c704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:01.149371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c537c7d-6b02-4b4f-9448-467a2b15c704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:01.150966 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c537c7d-6b02-4b4f-9448-467a2b15c704 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:01.161809 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1281/2556] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:01.165984 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:01.176577 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb9e88-22f8-4828-8ba9-ea78850d2ae1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:01.181131 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:01.181763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:01.182038 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:01.182306 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] PATH_INFO: `/v3/projects/f11e9c8fbe3249109325284f3c8f7ed1/users/580654a249054de988b86d6c1e3f6ee1/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:01.184206 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11e9c8fbe3249109325284f3c8f7ed1, user_id=580654a249054de988b86d6c1e3f6ee1, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:01.186863 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:01.196661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1276/2557] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:01 2022] PUT /identity/v3/projects/f11e9c8fbe3249109325284f3c8f7ed1/users/580654a249054de988b86d6c1e3f6ee1/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:01.258627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:01.258888 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:01.259154 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:01.287949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] MFA Rules not processed for user `580654a249054de988b86d6c1e3f6ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:01.289176 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:01.354574 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1282/2558] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:01.365608 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:01.367428 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:01.424553 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735ee2-b663-4369-8c03-fa320108a124 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:01.428108 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:01.428726 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:01.429001 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:01.429269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:01.433199 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:01.486413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:01.487758 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:01.496480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1277/2559] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:05.690347 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:05.691775 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:05.703423 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4a292-0da1-4991-bb63-fb2c45033498 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:05.706890 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f20607-4255-4c26-825b-a8ed7fc4e5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:05.707474 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f20607-4255-4c26-825b-a8ed7fc4e5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:05.707750 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f20607-4255-4c26-825b-a8ed7fc4e5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:05.708016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f20607-4255-4c26-825b-a8ed7fc4e5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:05.717158 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f20607-4255-4c26-825b-a8ed7fc4e5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:05.718593 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f20607-4255-4c26-825b-a8ed7fc4e5e5 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:05.727666 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1283/2560] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:10.601545 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:10.663005 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4f15a-0b93-46ed-b2ac-38b50b3faeb5 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:10.667450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:10.668762 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:10.669044 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:10.669317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] PATH_INFO: `/v3/users/cae821ee854f4e09af658ed316ab8d87` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:10.670425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae821ee854f4e09af658ed316ab8d87)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:10.672317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:10.716273 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae821ee854f4e09af658ed316ab8d87'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.728191 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae821ee854f4e09af658ed316ab8d87'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.728872 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae821ee854f4e09af658ed316ab8d87'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.736648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae821ee854f4e09af658ed316ab8d87'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.743737 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae821ee854f4e09af658ed316ab8d87'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:10.749613 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1278/2561] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:10 2022] DELETE /identity/v3/users/cae821ee854f4e09af658ed316ab8d87 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:10.754132 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:10.754655 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:10.754763 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:10.773671 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:10.774873 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:10.833309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1284/2562] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 26 11:16:10.843342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:10.844816 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:10.874074 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:10.904792 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ef91b-485f-4c41-afac-756af0349402 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:10.908529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:10.909132 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:10.909409 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:10.909678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:10.919048 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:10.920484 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:10.929733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1279/2563] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:11.191831 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.193261 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.205870 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614415d-19e4-43a3-9eb3-d5cb259f0684 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.210624 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.211258 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.211533 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.211835 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] PATH_INFO: `/v3/projects/09d836696a9b404fab255c913942040c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.212977 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d836696a9b404fab255c913942040c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.214905 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.242191 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:11.264167 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d836696a9b404fab255c913942040c', 'request_id': 'req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.271063 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d836696a9b404fab255c913942040c', 'request_id': 'req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.276522 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d836696a9b404fab255c913942040c', 'request_id': 'req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.287911 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] The token cache is being invalidate because project 09d836696a9b404fab255c913942040c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:11.288198 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.288853 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.290554 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1285/2564] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:11 2022] DELETE /identity/v3/projects/09d836696a9b404fab255c913942040c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:11.295025 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.308586 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384454d-ab69-48ef-86e6-f7bd691e9242 service neutron] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.365115 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.365675 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.365955 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.366228 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] PATH_INFO: `/v3/users/580654a249054de988b86d6c1e3f6ee1` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.367336 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580654a249054de988b86d6c1e3f6ee1)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.369324 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.414925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580654a249054de988b86d6c1e3f6ee1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.427483 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580654a249054de988b86d6c1e3f6ee1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.428137 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580654a249054de988b86d6c1e3f6ee1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.434933 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580654a249054de988b86d6c1e3f6ee1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.441906 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-77b57ee7-9492-4639-bab5-ae069b543856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580654a249054de988b86d6c1e3f6ee1'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.447700 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1280/2565] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:11 2022] DELETE /identity/v3/users/580654a249054de988b86d6c1e3f6ee1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:11.712025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:11.713492 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.727259 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6b55-fc0a-48df-9a6d-8f43102a8186 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:11.784000 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:11.784680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.784936 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.785199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] PATH_INFO: `/v3/projects/f11e9c8fbe3249109325284f3c8f7ed1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.786292 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11e9c8fbe3249109325284f3c8f7ed1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:11.788150 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:11.832896 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11e9c8fbe3249109325284f3c8f7ed1', 'request_id': 'req-bf9da64d-0638-4264-a398-8d8cb77e9b6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.839794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11e9c8fbe3249109325284f3c8f7ed1', 'request_id': 'req-bf9da64d-0638-4264-a398-8d8cb77e9b6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.845934 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11e9c8fbe3249109325284f3c8f7ed1', 'request_id': 'req-bf9da64d-0638-4264-a398-8d8cb77e9b6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.857013 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] The token cache is being invalidate because project f11e9c8fbe3249109325284f3c8f7ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:11.857302 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.857967 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bf9da64d-0638-4264-a398-8d8cb77e9b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:11.859461 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1286/2566] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:11 2022] DELETE /identity/v3/projects/f11e9c8fbe3249109325284f3c8f7ed1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:11.866029 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.866593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.866593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.887326 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:11.888723 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.931270 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:11.950083 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1281/2567] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:11.958137 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:11.958422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:11.958698 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:11.978306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:11.979512 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:11.988065 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1287/2568] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:11.992158 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.002220 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f06d6-edcd-4f84-adf1-6a93bb1d5e5a None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.006666 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.007253 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.007525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.007794 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.008459 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:16:12.008761 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.010325 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.021894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1282/2569] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:16:12.026041 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.035159 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56d0c4-5ca9-4e53-ac73-eaae12413ea2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.039839 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.040459 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.040740 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.041012 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.041641 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.044120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.072773 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1288/2570] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:12.076934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.086901 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7a92-8b68-4c64-9c80-9fd3908faf76 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.145718 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.146247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.146531 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.146808 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.147434 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.149381 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.171317 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1283/2571] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:12 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:12.175331 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.185524 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77088b4-cc95-4a96-98f9-a5aa0b630954 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.190215 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.190824 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.191096 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.191362 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.191988 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.193755 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.203749 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1289/2572] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:12.207654 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.218057 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b548ad-4711-407f-b335-28f47e2333c1 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.222584 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63517c-bc38-4e58-b50d-0d9842122e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.223166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63517c-bc38-4e58-b50d-0d9842122e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.223439 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63517c-bc38-4e58-b50d-0d9842122e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.223706 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63517c-bc38-4e58-b50d-0d9842122e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.224328 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63517c-bc38-4e58-b50d-0d9842122e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.225911 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63517c-bc38-4e58-b50d-0d9842122e53 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.237109 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1284/2573] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:12.241049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.246196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:12.252197 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838c704-5715-41ed-bf52-cda37c11b39c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.258240 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.258895 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.259151 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.259418 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] PATH_INFO: `/v3/projects/6ed43e8de4894812ba6c4092a2308242/users/b97a96b0180c4d1b8c977d092645a5f4/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.273678 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed43e8de4894812ba6c4092a2308242, user_id=b97a96b0180c4d1b8c977d092645a5f4, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.276297 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.289044 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1290/2574] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:12 2022] PUT /identity/v3/projects/6ed43e8de4894812ba6c4092a2308242/users/b97a96b0180c4d1b8c977d092645a5f4/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:12.302290 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.302574 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.302843 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.330296 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] MFA Rules not processed for user `b97a96b0180c4d1b8c977d092645a5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:12.331517 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.396222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1285/2575] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:12.408142 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.409861 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.466196 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5be3-209e-403e-b4dd-2de07fee79ab admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.469795 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ec193-108e-42dc-9816-a53ff5587bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.470393 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ec193-108e-42dc-9816-a53ff5587bfd service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.470668 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ec193-108e-42dc-9816-a53ff5587bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.470938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ec193-108e-42dc-9816-a53ff5587bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.479090 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ec193-108e-42dc-9816-a53ff5587bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.480582 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ec193-108e-42dc-9816-a53ff5587bfd service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.489447 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1291/2576] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:12.510819 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.555856 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:12.574091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ccecd-1f63-4930-959a-b3acb99c52eb None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.579170 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.579793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.580071 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.580397 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] PATH_INFO: `/v3/users/b97a96b0180c4d1b8c977d092645a5f4` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.581522 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97a96b0180c4d1b8c977d092645a5f4)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.583422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.630269 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97a96b0180c4d1b8c977d092645a5f4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:12.642468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97a96b0180c4d1b8c977d092645a5f4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:12.643135 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97a96b0180c4d1b8c977d092645a5f4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:12.649990 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97a96b0180c4d1b8c977d092645a5f4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:12.657853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97a96b0180c4d1b8c977d092645a5f4'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:12.663748 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1286/2577] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:12 2022] DELETE /identity/v3/users/b97a96b0180c4d1b8c977d092645a5f4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:12.668437 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.668725 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.669001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.687807 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:12.689129 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.746696 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1292/2578] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:12.756555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:12.758037 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:12.814538 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e773-a9d5-4189-912f-80b0e3e992b3 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:12.818211 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fade-3ee2-46ab-b147-41b36eacc372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:12.818799 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fade-3ee2-46ab-b147-41b36eacc372 service neutron] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:12.819076 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fade-3ee2-46ab-b147-41b36eacc372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:12.819347 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fade-3ee2-46ab-b147-41b36eacc372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:12.828715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fade-3ee2-46ab-b147-41b36eacc372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:12.830124 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fade-3ee2-46ab-b147-41b36eacc372 service neutron] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:12.839258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1287/2579] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:13.098647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.101342 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:13.112924 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211228c-9f94-47bb-8331-3e5bc42f6799 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.118109 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.118744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.119023 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.119350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] PATH_INFO: `/v3/projects/6ed43e8de4894812ba6c4092a2308242` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.120525 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed43e8de4894812ba6c4092a2308242)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.122950 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.171366 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed43e8de4894812ba6c4092a2308242', 'request_id': 'req-17123e3a-2238-4630-b452-b475a86e8c30'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:13.178729 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed43e8de4894812ba6c4092a2308242', 'request_id': 'req-17123e3a-2238-4630-b452-b475a86e8c30'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:13.184830 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed43e8de4894812ba6c4092a2308242', 'request_id': 'req-17123e3a-2238-4630-b452-b475a86e8c30'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:13.196062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] The token cache is being invalidate because project 6ed43e8de4894812ba6c4092a2308242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:13.196405 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:13.197062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-17123e3a-2238-4630-b452-b475a86e8c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:13.198519 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1293/2580] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:13 2022] DELETE /identity/v3/projects/6ed43e8de4894812ba6c4092a2308242 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:13.203981 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.204480 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.204594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.223765 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:13.224974 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:13.283078 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1288/2581] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:13.290741 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.291030 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.291306 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.300439 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:13.313464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:13.315088 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:13.323016 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1294/2582] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:13.327259 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.333525 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:13.337271 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c944-a175-49a0-bf11-7a37e903b8b4 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.342940 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.343653 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.344166 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.344733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] PATH_INFO: `/v3/domains` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.345425 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 26 11:16:13.346058 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.347715 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.361960 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1289/2583] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Oct 26 11:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 26 11:16:13.366497 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.376451 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829a52d-59f1-450f-bc62-b05fd529a6f9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.381199 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.381798 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.382077 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.382350 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.382983 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.384917 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.411011 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1295/2584] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:13.415258 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.425632 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d00a12-66e5-4eeb-bc2a-5982a8d41748 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.479821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.480367 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.481157 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.481422 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.482023 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.483909 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.505056 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1290/2585] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 26 11:16:13.509267 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.519388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d957d-6797-44a1-9c46-1c2e50875667 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.524027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.524664 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.524938 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.525206 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.525836 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.527422 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.537110 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1296/2586] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:13.540786 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.550795 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d93e4-08d9-4563-9507-0ac3136eb1dd admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.555292 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d87cc0-6a84-4768-9db4-a240ee2e3d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.555861 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d87cc0-6a84-4768-9db4-a240ee2e3d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.556138 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d87cc0-6a84-4768-9db4-a240ee2e3d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.556441 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d87cc0-6a84-4768-9db4-a240ee2e3d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.557065 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d87cc0-6a84-4768-9db4-a240ee2e3d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.559163 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d87cc0-6a84-4768-9db4-a240ee2e3d49 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.569556 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1291/2587] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:13.573356 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.583031 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f33a20-2635-4581-9254-59e0d34c48b6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.587537 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.588186 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.588499 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.588771 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] PATH_INFO: `/v3/projects/0be52338b64549249874775a928f7cac/users/c88df1fda5164419ac7578c11ac47860/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.604886 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be52338b64549249874775a928f7cac, user_id=c88df1fda5164419ac7578c11ac47860, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.608192 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.621365 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1297/2588] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:13 2022] PUT /identity/v3/projects/0be52338b64549249874775a928f7cac/users/c88df1fda5164419ac7578c11ac47860/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:13.631513 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.631804 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.632082 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.659939 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] MFA Rules not processed for user `c88df1fda5164419ac7578c11ac47860`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:13.661250 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:13.724779 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1292/2589] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:13.729224 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.789963 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b586dc-7a21-4fcc-94f2-9be291e82afd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.795106 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.795690 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.795961 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.796227 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.796874 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.798745 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.823801 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1298/2590] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:13.828021 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.838633 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381b780-db1d-414b-803d-5705d6949ab6 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.894934 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.895540 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.895821 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.896091 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.896745 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.898648 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.907036 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:13.921040 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1293/2591] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:13 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:13.925140 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.935225 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5bc6e-79a8-4d98-bd12-6be1343e0850 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.939716 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.940298 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.940603 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.940872 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.941528 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.943093 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.954038 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1299/2592] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:13.957993 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:13.968481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417aaba-49f3-44f0-832c-277e8d9771f8 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:13.973175 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede555d7-f9cb-4e7e-b429-cda9c9b8e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:13.973763 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede555d7-f9cb-4e7e-b429-cda9c9b8e48a admin admin] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:13.974069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede555d7-f9cb-4e7e-b429-cda9c9b8e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:13.974344 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede555d7-f9cb-4e7e-b429-cda9c9b8e48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:13.974980 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede555d7-f9cb-4e7e-b429-cda9c9b8e48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:13.976594 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede555d7-f9cb-4e7e-b429-cda9c9b8e48a admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:13.987133 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1294/2593] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:13.991001 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.001472 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d8b62-7983-4df2-b4e4-4033d816defe admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.006028 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.006660 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.006949 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.007214 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] PATH_INFO: `/v3/projects/d694599ba4d64e61944a30b8d1ffe534/users/c4cc5adef8dd4ebb9b34301ade53ce38/roles/3b1990b4aec64813be7704740acbd303` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.021654 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d694599ba4d64e61944a30b8d1ffe534, user_id=c4cc5adef8dd4ebb9b34301ade53ce38, role_id=3b1990b4aec64813be7704740acbd303)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.024277 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.036388 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1300/2594] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:13 2022] PUT /identity/v3/projects/d694599ba4d64e61944a30b8d1ffe534/users/c4cc5adef8dd4ebb9b34301ade53ce38/roles/3b1990b4aec64813be7704740acbd303 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:14.048123 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.048369 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.048678 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.076884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] MFA Rules not processed for user `c4cc5adef8dd4ebb9b34301ade53ce38`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:14.078085 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:14.141457 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1295/2595] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:14.146006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.195826 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:14.208119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae9a6-1fca-46e3-b722-26ae12d04ac7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.212733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.213328 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.213611 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.213882 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.214500 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.217025 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.242343 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1301/2596] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Oct 26 11:16:14 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:14.246447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.256985 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9857-e0b3-46af-a2ec-52e7ef8a0909 None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.314551 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.315088 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.315360 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.315623 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] PATH_INFO: `/v3/users` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.316247 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.318234 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.339516 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1296/2597] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Oct 26 11:16:14 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 26 11:16:14.343636 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.353803 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8de2-87d1-492b-9591-d850cd4e785a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.358397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.358986 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.359263 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.359536 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.360476 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.362048 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.374460 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1302/2598] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:14.378430 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.388951 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fab67-10d4-478b-942b-c00b86b8142c admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.393505 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.394153 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.394447 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.394680 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] PATH_INFO: `/v3/projects/8e28ad3d849343e28a560841e32b1f94/users/5c3334cd349e42c7bdaedcf9bbc32feb/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.409591 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e28ad3d849343e28a560841e32b1f94, user_id=5c3334cd349e42c7bdaedcf9bbc32feb, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.412244 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.424661 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1297/2599] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:14 2022] PUT /identity/v3/projects/8e28ad3d849343e28a560841e32b1f94/users/5c3334cd349e42c7bdaedcf9bbc32feb/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:14.428559 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.438931 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e84a3e-cf3d-49e3-91d0-26bc9386ab4a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.493679 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e5e25-52e0-4e14-b0cf-007faa179bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.494271 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5e25-52e0-4e14-b0cf-007faa179bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.494575 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5e25-52e0-4e14-b0cf-007faa179bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.494956 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5e25-52e0-4e14-b0cf-007faa179bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.495595 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e5e25-52e0-4e14-b0cf-007faa179bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.497837 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e5e25-52e0-4e14-b0cf-007faa179bdc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.507363 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1303/2600] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Oct 26 11:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 26 11:16:14.511450 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.522049 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd542e3-ed24-4874-a24b-beb960d1c244 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.526593 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.527285 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.527559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.527830 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] PATH_INFO: `/v3/projects/8e28ad3d849343e28a560841e32b1f94/users/5c3334cd349e42c7bdaedcf9bbc32feb/roles/908e0bd4dbaf48168221f4987ad7df3d` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.529741 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e28ad3d849343e28a560841e32b1f94, user_id=5c3334cd349e42c7bdaedcf9bbc32feb, role_id=908e0bd4dbaf48168221f4987ad7df3d)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.532349 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.542196 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1298/2601] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Oct 26 11:16:14 2022] PUT /identity/v3/projects/8e28ad3d849343e28a560841e32b1f94/users/5c3334cd349e42c7bdaedcf9bbc32feb/roles/908e0bd4dbaf48168221f4987ad7df3d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:14.552069 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.552382 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.552665 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.580709 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] MFA Rules not processed for user `5c3334cd349e42c7bdaedcf9bbc32feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:14.581912 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:14.649789 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1304/2602] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:14.661093 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:14.662839 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:14.685314 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:14.720559 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169c2cc-00a6-424a-aecd-52a5adcebb20 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:14.724310 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:14.724945 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:14.725231 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:14.725530 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:14.781226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:14.782643 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:14.791151 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1299/2603] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:16.289711 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:16.291083 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:16.303530 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e616-c522-4d8d-864c-6cfcea2f311e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:16.307060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:16.307647 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:16.307922 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:16.308185 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:16.350744 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:16.364875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:16.366303 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:16.375541 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1305/2604] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:16.893107 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:16.901702 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b59c6c-423a-449e-9306-dc0843487821 service cinder] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:16.905823 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b60504-f509-4e69-b12e-815e7b5caa7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7700f8cf7049e18a9a530c00bb4d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:16.906413 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60504-f509-4e69-b12e-815e7b5caa7b service cinder] REQUEST_METHOD: `GET` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:16.906691 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60504-f509-4e69-b12e-815e7b5caa7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:16.906962 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60504-f509-4e69-b12e-815e7b5caa7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:16.915894 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b60504-f509-4e69-b12e-815e7b5caa7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:16.917338 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b60504-f509-4e69-b12e-815e7b5caa7b service cinder] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:16.927142 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1300/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:20.794062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:20.855049 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6ddc0-ba03-4189-a322-c6e0489ed198 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:20.859784 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:20.860748 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:20.861119 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:20.861364 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] PATH_INFO: `/v3/users/c88df1fda5164419ac7578c11ac47860` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:20.862692 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88df1fda5164419ac7578c11ac47860)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:20.864794 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:20.910987 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88df1fda5164419ac7578c11ac47860'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.922676 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88df1fda5164419ac7578c11ac47860'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.923348 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88df1fda5164419ac7578c11ac47860'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.930060 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88df1fda5164419ac7578c11ac47860'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.937868 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88df1fda5164419ac7578c11ac47860'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:20.944120 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1306/2606] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:20 2022] DELETE /identity/v3/users/c88df1fda5164419ac7578c11ac47860 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:20.948361 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] REQUEST_METHOD: `POST` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:20.948853 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:20.949486 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:20.968869 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.auth.core [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] MFA Rules not processed for user `1f7b517c3fb74340aafc06f3b489374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 26 11:16:20.970069 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:21.028470 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1301/2607] 10.222.0.49 () {58 vars in 958 bytes} [Wed Oct 26 11:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 26 11:16:21.037825 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.039254 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:21.098970 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c6f71-71c0-4e81-8418-2555efb64024 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.102762 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e032cd87fb84d818b509c5af33716ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.103397 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.103675 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.103945 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.113487 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.114891 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.124634 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1307/2608] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:16:21.653927 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.655472 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:21.667507 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc2b6-d2d6-4445-a0ca-811749acff3a None None] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.672925 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.673542 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.673733 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.673966 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] PATH_INFO: `/v3/projects/0be52338b64549249874775a928f7cac` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.675372 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be52338b64549249874775a928f7cac)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.677406 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.724226 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be52338b64549249874775a928f7cac', 'request_id': 'req-34216ae4-c080-441f-ab63-1d5e3bc86b98'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.731342 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be52338b64549249874775a928f7cac', 'request_id': 'req-34216ae4-c080-441f-ab63-1d5e3bc86b98'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.732583 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:21.738703 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be52338b64549249874775a928f7cac', 'request_id': 'req-34216ae4-c080-441f-ab63-1d5e3bc86b98'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.750793 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] The token cache is being invalidate because project 0be52338b64549249874775a928f7cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:21.751070 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.751721 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.753222 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1302/2609] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:21 2022] DELETE /identity/v3/projects/0be52338b64549249874775a928f7cac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:21.757359 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:21.767680 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafe1b6-0c9a-41a1-b38f-099221bc3a34 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:21.771146 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:21.824875 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:21.825532 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:21.825701 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:21.825969 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] PATH_INFO: `/v3/users/c4cc5adef8dd4ebb9b34301ade53ce38` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:21.827084 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cc5adef8dd4ebb9b34301ade53ce38)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:21.829027 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:21.874204 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cc5adef8dd4ebb9b34301ade53ce38'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.887216 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cc5adef8dd4ebb9b34301ade53ce38'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.888006 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cc5adef8dd4ebb9b34301ade53ce38'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.895352 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cc5adef8dd4ebb9b34301ade53ce38'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.902632 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cc5adef8dd4ebb9b34301ade53ce38'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:21.908553 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1308/2610] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:21 2022] DELETE /identity/v3/users/c4cc5adef8dd4ebb9b34301ade53ce38 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:22.173332 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.174780 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.190105 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34216ae4-c080-441f-ab63-1d5e3bc86b98 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.247913 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.248567 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.248848 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.249119 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] PATH_INFO: `/v3/projects/d694599ba4d64e61944a30b8d1ffe534` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.250225 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d694599ba4d64e61944a30b8d1ffe534)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.252106 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.297392 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd694599ba4d64e61944a30b8d1ffe534', 'request_id': 'req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.304600 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd694599ba4d64e61944a30b8d1ffe534', 'request_id': 'req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.310400 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd694599ba4d64e61944a30b8d1ffe534', 'request_id': 'req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.321529 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] The token cache is being invalidate because project d694599ba4d64e61944a30b8d1ffe534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:22.321814 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.322429 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.323884 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1303/2611] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:22 2022] DELETE /identity/v3/projects/d694599ba4d64e61944a30b8d1ffe534 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:22.328309 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.329717 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.342842 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d63db-88f3-4d34-a1f9-e86d354d4d58 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.398022 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.398578 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.398855 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.399127 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] PATH_INFO: `/v3/users/5c3334cd349e42c7bdaedcf9bbc32feb` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.400232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3334cd349e42c7bdaedcf9bbc32feb)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.402772 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.431062 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:22.449733 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3334cd349e42c7bdaedcf9bbc32feb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.461720 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3334cd349e42c7bdaedcf9bbc32feb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.462371 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3334cd349e42c7bdaedcf9bbc32feb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.469217 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3334cd349e42c7bdaedcf9bbc32feb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.476264 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3334cd349e42c7bdaedcf9bbc32feb'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.482594 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1309/2612] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Oct 26 11:16:22 2022] DELETE /identity/v3/users/5c3334cd349e42c7bdaedcf9bbc32feb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:22.741077 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Authenticating user token {{(pid=81544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:16:22.742477 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.fernet_utils [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:16:22.757197 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3b569-8b2a-46aa-91ad-df2c4da93bb9 admin admin] Validating token access rules against request {{(pid=81544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:16:22.814844 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f7b517c3fb74340aafc06f3b489374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '984efe81cc5c444a9df8508547d09873', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:16:22.815468 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:16:22.815746 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:16:22.816015 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] PATH_INFO: `/v3/projects/8e28ad3d849343e28a560841e32b1f94` {{(pid=81544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:16:22.817305 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e28ad3d849343e28a560841e32b1f94)` {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:16:22.819242 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] RBAC: Authorization granted {{(pid=81544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:16:22.835454 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:22.866568 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e28ad3d849343e28a560841e32b1f94', 'request_id': 'req-78de6965-e921-406b-ba8e-32b00811ae76'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.873957 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e28ad3d849343e28a560841e32b1f94', 'request_id': 'req-78de6965-e921-406b-ba8e-32b00811ae76'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.879418 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e28ad3d849343e28a560841e32b1f94', 'request_id': 'req-78de6965-e921-406b-ba8e-32b00811ae76'} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.890555 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] The token cache is being invalidate because project 8e28ad3d849343e28a560841e32b1f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 26 11:16:22.890862 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.891481 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG keystone.notifications [None req-78de6965-e921-406b-ba8e-32b00811ae76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 26 11:16:22.892956 dv-cinder-815582-18-smb devstack@keystone.service[81544]: [pid: 81544|app: 0|req: 1304/2613] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Oct 26 11:16:22 2022] DELETE /identity/v3/projects/8e28ad3d849343e28a560841e32b1f94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 26 11:16:32.478706 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:32.887380 dv-cinder-815582-18-smb devstack@keystone.service[81544]: DEBUG dbcounter [-] [81544] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:10.664168 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 26 11:18:10.665640 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:10.732892 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef57153-81af-4a72-a8b1-cd4ff03d3c07 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 26 11:18:10.791429 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b273370ae8bd45098d44997b5b2c6a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9140375e7b4649c7b81de93d8e3b34fe', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 26 11:18:10.792033 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 26 11:18:10.792316 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 26 11:18:10.792627 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 26 11:18:10.794337 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 26 11:18:10.805464 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 26 11:18:10.807043 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5972258-8628-4e40-a9e9-31b45e0331e5 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 26 11:18:10.817480 dv-cinder-815582-18-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1310/2614] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Oct 26 11:18:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 26 11:18:20.813232 dv-cinder-815582-18-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=58 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}